00000001:02000400:2.0F:1787359719.590965:0:2971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787359737.640090:0:3194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787359739.476850:0:3257:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1019 MB/s 00000001:01000000:0.0F:1787359739.726954:0:3257:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 847 MB/s 00000001:01000000:2.0:1787359739.976870:0:3257:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6579 MB/s 00000020:02000000:0.0:1787359740.548183:0:3286:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_45_g4630995 00000400:02000000:0.0:1787359741.426222:0:3301:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.114@tcp [8/256/0/180] 00008000:02000000:0.0:1787359744.594652:0:3451:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787359789.785119:0:5258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787359798.193615:0:5842:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787359798.193622:0:5842:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787359798.193787:0:5842:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003987fe23 00000080:02000400:2.0:1787359798.193799:0:5842:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787359798.199654:0:5842:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787359798.199668:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787359798.199794:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000e3cb739d) 00000020:00000080:2.0:1787359798.199815:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787359798.228982:0:5842:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787359798.229419:0:5842:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787359798.260210:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787359798.260255:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787359798.260278:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787359798.260329:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787359798.260356:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787359798.261969:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787359798.261980:0:5842:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787359798.261992:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef33e2 00000020:01000004:0.0:1787359798.262000:0:5842:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787359798.262005:0:5842:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787359798.262085:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003987fe23 from MGS 00000020:01000004:0.0:1787359798.262091:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787359798.262126:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f800c952) 00000020:00000080:0.0:1787359798.262140:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787359798.262259:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003987fe23 from MGS, refs=2 00080000:01000000:0.0:1787359798.262264:0:5842:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787359798.262271:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef33f0 00000100:00100000:0.0:1787359798.262411:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787359798.262556:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787359798.262563:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0F:1787359798.271795:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787359798.271828:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787359798.282916:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359798.283190:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787359798.283196:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787359798.292307:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787359798.292326:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787359798.292959:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787359798.292965:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787359798.296513:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359798.296520:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359798.296523:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359798.299366:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359798.299373:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359798.299375:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359798.300114:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787359798.301853:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787359798.549859:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3567 MB/s 00000001:01000000:2.0:1787359798.799771:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4511 MB/s 00000001:01000000:2.0:1787359799.050298:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 771 MB/s 00000001:01000000:3.0:1787359799.300207:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 971 MB/s 00080000:10000000:3.0:1787359799.306790:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787359799.320248:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787359799.320276:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787359799.320280:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787359799.320977:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787359799.321037:0:5842:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787359799.321072:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787359799.321242:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787359799.321269:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787359799.321564:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787359799.322019:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787359799.322026:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787359799.327119:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787359799.327132:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787359799.327480:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787359799.327486:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787359799.328350:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787359799.328370:0:5842:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.114@tcp' 00000020:01000004:3.0:1787359799.328372:0:5842:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787359799.328420:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.114@tcp (typ=mgc) 00000020:00000080:3.0:1787359799.328441:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.114@tcp (00000000b5816c73) 00000020:00000080:3.0:1787359799.328457:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787359799.328545:0:5842:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000031806f31@MGC192.168.201.114@tcp: add connection 192.168.201.114@tcp at head 00010000:00010000:3.0:1787359799.328737:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.114@tcp-0 is initialized 00000040:01000000:3.0:1787359799.328743:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787359799.330725:0:5857:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787359799.337270:0:5858:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787359799.337529:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.114@tcp (uuid 6055641b-d743-4e3c-a711-70d92fdecc0d) 00000020:00000080:3.0:1787359799.337554:0:5842:0:(genops.c:1385:class_connect()) connect: client 6055641b-d743-4e3c-a711-70d92fdecc0d, cookie 0x72f6de40e4ef33fe 00000100:00080000:3.0:1787359799.337566:0:5842:0:(import.c:510:import_select_connection()) MGC192.168.201.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787359799.337571:0:5842:0:(import.c:624:import_select_connection()) MGC192.168.201.114@tcp: import 0000000031806f31 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:3.0:1787359799.337618:0:5842:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007b854d81 x1874182527778944/t0(0) o250->MGC192.168.201.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787359799.337647:0:5842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6055641b-d743-4e3c-a711-70d92fdecc0d->MGS 00000020:01000004:3.0:1787359799.337671:0:5842:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787359799.337709:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787359799.337729:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fdee934b) 00000020:00000080:3.0:1787359799.337742:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787359799.341471:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b854d81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6055641b-d743-4e3c-a711-70d92fdecc0d:3316:1874182527778944:0@lo:250: 00000100:00100000:0.0:1787359799.341565:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359799.341653:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527778944 00000100:00100000:0.0:1787359799.341662:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527778944 00000100:00100000:0.0:1787359799.341742:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359799.341749:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eab4f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1874182527778944:12345-0@lo:250: 00010000:00080000:0.0:1787359799.341773:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6055641b-d743-4e3c-a711-70d92fdecc0d@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1787359799.341810:0:5853:0:(genops.c:1385:class_connect()) connect: client 6055641b-d743-4e3c-a711-70d92fdecc0d, cookie 0x72f6de40e4ef340c 00000100:00080000:0.0:1787359799.341954:0:5853:0:(import.c:65:import_set_state_nolock()) 00000000dcb14b68 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359799.342003:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eab4f14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:3316:x1874182527778944:12345-0@lo:250: Request processed in 254us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359799.342011:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359799.342052:0:3316:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787359799.342061:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1787359799.342067:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787359799.342071:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787359799.342074:0:3316:0:(import.c:65:import_set_state_nolock()) 0000000031806f31 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787359799.342076:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787359799.342083:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787359799.342088:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b854d81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6055641b-d743-4e3c-a711-70d92fdecc0d:3316:1874182527778944:0@lo:250: 00010000:00010000:0.0:1787359799.343182:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359799.366292:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359799.366516:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787359799.366522:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787359799.367224:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787359799.367232:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787359799.367565:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787359799.367572:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787359799.368402:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359799.369031:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787359799.369039:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787359799.370198:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787359799.370210:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787359799.413397:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359799.413605:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787359799.413612:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787359799.414761:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787359799.414772:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787359799.417406:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359799.417611:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787359799.417617:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787359799.419187:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787359799.419199:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787359799.419794:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359799.419969:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787359799.419975:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787359799.420663:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787359799.420670:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787359799.421257:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787359799.421398:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787359799.421402:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787359799.421921:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787359799.421929:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787359799.456485:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359799.456945:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787359799.456953:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787359799.459310:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787359799.459324:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787359799.461208:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787359799.461224:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787359799.463375:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787359799.463399:0:5842:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787359799.463405:0:5842:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787359799.463535:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787359799.463567:0:5842:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.114@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787359799.463572:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787359799.463574:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359799.463575:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359799.463576:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359799.463577:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359799.463579:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359799.463580:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359799.463581:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359799.463583:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359799.463584:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359799.463585:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359799.463587:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787359799.463589:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787359799.463591:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359799.463592:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359799.463593:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359799.463594:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359799.463596:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359799.463597:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359799.463598:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359799.463599:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359799.463599:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359799.463600:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359799.463601:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359799.463602:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787359799.463640:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787359799.463662:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a44be69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779072:0@lo:253: 00000100:00100000:0.0:1787359799.463869:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359799.463920:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6b37663 going to sleep for 11 seconds 00000100:00100000:3.0:1787359799.464051:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779072 00000100:00100000:3.0:1787359799.464059:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779072 00000100:00100000:3.0:1787359799.464101:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787359799.464110:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051f70216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5842:x1874182527779072:12345-0@lo:253: 20000000:01000000:3.0:1787359799.464155:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787359799.464158:0:5856:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787359799.465311:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787359799.465384:0:5856:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787359799.465770:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359799.468450:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787359799.468953:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787359799.468958:0:5856:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787359799.468964:0:5856:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787359799.468967:0:5856:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787359799.468983:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787359799.469292:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359799.469526:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787359799.469539:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787359799.469587:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787359799.469636:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787359799.469713:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787359799.469800:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787359799.469809:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787359799.469853:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787359799.469862:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787359799.469891:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787359799.469897:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787359799.469925:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787359799.469987:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787359799.470016:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787359799.470021:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787359799.470042:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359799.470245:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787359799.470255:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787359799.470286:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787359799.470335:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787359799.470389:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787359799.470401:0:5856:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787359799.470481:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787359799.470490:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787359799.470536:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787359799.470574:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787359799.470607:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787359799.470618:0:5856:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787359799.470751:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787359799.470760:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787359799.470793:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787359799.470829:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787359799.470986:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787359799.471035:0:5856:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787359799.471042:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787359799.475169:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787359799.475546:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787359799.475578:0:5856:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.114@tcp for mdt 20000000:01000000:2.0:1787359799.475581:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.114@tcp (null) (null) (null) 00000040:00080000:2.0:1787359799.475616:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787359799.475624:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787359799.475657:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787359799.475664:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.114@tcp (null) (null) 00000040:00080000:2.0:1787359799.475969:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787359799.475982:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787359799.476016:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787359799.476052:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787359799.476125:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787359799.476129:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787359799.476134:0:5856:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787359799.476140:0:5856:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787359799.478020:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787359799.478176:0:5856:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787359799.485998:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787359799.486054:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787359799.486131:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787359799.486149:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787359799.486152:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787359799.486155:0:5856:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787359799.486168:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787359799.486170:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787359799.486198:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787359799.486201:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787359799.489266:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787359799.489856:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787359799.489909:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787359799.490128:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787359799.490145:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787359799.490148:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787359799.494368:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787359799.494772:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787359799.494819:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787359799.494892:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1787359799.494909:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787359799.494912:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787359799.494919:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787359799.494969:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.494985:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.494995:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495001:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495007:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495012:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495018:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cfa10e2e already unused, calling callback (0000000065106302) 00010000:00010000:2.0:1787359799.495021:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495028:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495039:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495046:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359799.495051:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef3413 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787359799.495083:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787359799.744120:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051f70216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5842:x1874182527779072:12345-0@lo:253: Request processed in 280002us (280243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359799.744140:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359799.744142:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a44be69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779072:0@lo:253: 10000000:01000000:0.0:1787359799.744157:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787359799.744160:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787359799.744162:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359799.744163:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359799.744164:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787359799.744166:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359799.744167:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359799.744168:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359799.744170:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359799.744171:0:5842:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787359799.744172:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359799.744174:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787359799.744192:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003987fe23 from lustre-MDT0000 10000000:01000000:0.0:1787359799.744218:0:5842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787359799.744221:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787359799.744225:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff983d111f3370 10000000:01000000:0.0:1787359799.744229:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359799.744236:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff983d111f3370 from 1 10000000:01000000:0.0:1787359799.744239:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787359799.744274:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359799.744284:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359799.744293:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359799.744310:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a44be69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779200:0@lo:101: 00000100:00100000:0.0:1787359799.744351:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359799.744420:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000006795ca04 going to sleep for 11 seconds 00000100:00100000:1.0:1787359799.744486:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779200 00000100:00100000:1.0:1787359799.744492:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779200 00000100:00100000:1.0:1787359799.744536:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787359799.744543:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000381b51ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5842:x1874182527779200:12345-0@lo:101: 00010000:00010000:1.0:1787359799.744554:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359799.744566:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf8d5788/0x72f6de40e4ef3421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef341a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359799.744588:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf8d5788/0x72f6de40e4ef3421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359799.744597:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf8d5788/0x72f6de40e4ef3421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359799.744615:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf8d5788, rc 0) 00000100:00100000:1.0:1787359799.744649:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000381b51ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+6:5842:x1874182527779200:12345-0@lo:101: Request processed in 106us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359799.744655:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359799.744793:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a44be69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779200:0@lo:101: 00010000:00010000:3.0:1787359799.744805:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.744813:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359799.744854:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779328:0@lo:501: 00000100:00100000:3.0:1787359799.744901:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359799.744932:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b52146b1 going to sleep for 11 seconds 00000100:00100000:2.0:1787359799.745065:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779328 00000100:00100000:2.0:1787359799.745069:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779328 00000100:00100000:2.0:1787359799.745099:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787359799.745105:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000861265d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+6:5842:x1874182527779328:12345-0@lo:501: 00000100:00100000:2.0:1787359799.745333:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000861265d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+6:5842:x1874182527779328:12345-0@lo:501: Request processed in 227us (431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787359799.745341:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359799.745456:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779328:0@lo:501: 10000000:01000000:3.0:1787359799.745479:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787359799.745497:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.745504:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 00000000f8f92c7c/0x72f6de40e4ef341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359799.745511:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff983d0dccf000 10000000:01000000:3.0:1787359799.745515:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787359799.745518:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff983d0dccf000 10000000:01000000:3.0:1787359799.745520:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787359799.745522:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff983d0dccf000 from 1 10000000:01000000:3.0:1787359799.745524:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787359799.745542:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.745558:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.745565:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359799.745577:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779456:0@lo:101: 00000100:00100000:3.0:1787359799.745603:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359799.745667:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b52146b1 going to sleep for 11 seconds 00000100:00100000:1.0:1787359799.745893:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779456 00000100:00100000:1.0:1787359799.745899:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779456 00000100:00100000:1.0:1787359799.746038:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359799.746046:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cdf544b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+6:5842:x1874182527779456:12345-0@lo:101: 00010000:00010000:1.0:1787359799.746055:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359799.746064:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2fd14f2/0x72f6de40e4ef342f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3428 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359799.746079:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2fd14f2/0x72f6de40e4ef342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3428 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359799.746087:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2fd14f2/0x72f6de40e4ef342f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3428 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359799.746093:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2fd14f2, rc 0) 00000100:00100000:1.0:1787359799.746131:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cdf544b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+7:5842:x1874182527779456:12345-0@lo:101: Request processed in 87us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359799.746137:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787359799.746196:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779456:0@lo:101: 00010000:00010000:3.0:1787359799.746206:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.746213:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359799.746223:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787359799.746239:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.746245:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 000000004b22755b/0x72f6de40e4ef3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359799.746251:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787359799.746254:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787359799.746258:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff983d0dccf000 10000000:01000000:3.0:1787359799.746260:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787359799.746263:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787359799.746274:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787359799.746290:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.746297:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.746303:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359799.746312:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779584:0@lo:101: 00000100:00100000:3.0:1787359799.746336:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359799.748321:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b52146b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787359799.748413:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779584 00000100:00100000:0.0:1787359799.748422:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779584 00000100:00100000:0.0:1787359799.748468:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359799.748475:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000066493dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+7:5842:x1874182527779584:12345-0@lo:101: 00010000:00010000:0.0:1787359799.748490:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359799.748509:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003af6d9d5/0x72f6de40e4ef343d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3436 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359799.748532:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003af6d9d5/0x72f6de40e4ef343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359799.748541:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003af6d9d5/0x72f6de40e4ef343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359799.748550:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003af6d9d5, rc 0) 00000100:00100000:0.0:1787359799.748613:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000066493dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+8:5842:x1874182527779584:12345-0@lo:101: Request processed in 138us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359799.748620:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787359799.748719:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779584:0@lo:101: 00010000:00010000:3.0:1787359799.748733:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359799.748741:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359799.748795:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779712:0@lo:501: 00000100:00100000:3.0:1787359799.748821:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359799.748850:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b52146b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787359799.748897:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779712 00000100:00100000:0.0:1787359799.748902:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779712 00000100:00100000:0.0:1787359799.748929:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787359799.748935:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000acf1934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+8:5842:x1874182527779712:12345-0@lo:501: 00000100:00100000:0.0:1787359799.749185:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000acf1934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5842:x1874182527779712:12345-0@lo:501: Request processed in 250us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359799.749193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359799.749264:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779712:0@lo:501: 00000100:00100000:3.0:1787359799.749290:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779840:0@lo:503: 00000100:00100000:3.0:1787359799.749327:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359799.749348:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b52146b1 going to sleep for 11 seconds 00000100:00100000:1.0:1787359799.749652:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779840 00000100:00100000:1.0:1787359799.749658:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779840 00000100:00100000:1.0:1787359799.749754:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787359799.749761:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b007b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5842:x1874182527779840:12345-0@lo:503: 00000100:00100000:1.0:1787359799.749923:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b007b7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5842:x1874182527779840:12345-0@lo:503: Request processed in 163us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359799.749938:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359799.750006:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527779840:0@lo:503: 00000100:00100000:3.0:1787359799.750408:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5885:1874182527779968:0@lo:502: 00000100:00100000:3.0:1787359799.750445:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359799.750481:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b55d8d4b going to sleep for 11 seconds 00000100:00100000:1.0:1787359799.750612:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527779968 00000100:00100000:1.0:1787359799.750617:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527779968 00000100:00100000:1.0:1787359799.750756:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787359799.750764:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2f9fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5885:x1874182527779968:12345-0@lo:502: 00000100:00100000:1.0:1787359799.750928:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2f9fa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5885:x1874182527779968:12345-0@lo:502: Request processed in 165us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359799.751065:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5885:1874182527779968:0@lo:502: 00000020:01000000:3.0:1787359799.751091:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359799.751103:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359799.751106:0:5885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787359799.751111:0:5885:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787359799.751114:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359799.751129:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f320d404) 00000020:00000080:3.0:1787359799.751147:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787359799.751157:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787359799.751222:0:5885:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787359799.751229:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef344b 00000020:00000080:3.0:1787359799.751463:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787359799.751468:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359799.751471:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359799.751472:0:5885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787359799.751475:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359799.751479:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359799.751480:0:5885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787359799.751484:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787359799.751491:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006677483c) 00000020:00000080:3.0:1787359799.751500:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787359799.751504:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787359799.751506:0:5885:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787359799.751509:0:5885:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787359799.751515:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787359799.751570:0:5885:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003987fe23 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787359799.751591:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000031d36818) 00000020:00000080:3.0:1787359799.751600:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787359799.751648:0:5885:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787359799.751654:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef3460 00000020:00000080:3.0:1787359799.751780:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787359799.751786:0:5885:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787359799.751790:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72f6de40e4ef3467 00080000:01000000:3.0:1787359799.751795:0:5885:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787359799.751798:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef346e 00080000:10000000:3.0:1787359799.752164:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787359799.752350:0:5885:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 00000100:00100000:1.0:1787359799.752955:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 40000000:02000000:3.0:1787359799.758155:0:5885:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787359799.839332:0:5885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787359799.840011:0:5885:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787359799.843051:0:5885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787359799.843327:0:5885:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787359799.871484:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007f28cc38) 00000020:00000080:3.0:1787359799.871506:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787359799.871652:0:5885:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787359799.871659:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef347c 00000020:00000080:3.0:1787359799.882194:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787359799.884150:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359799.942393:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787359799.970140:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787359800.017881:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787359800.055659:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359800.109555:0:5885:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787359800.165741:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72f6de40e4ef3483 00000020:00000080:3.0:1787359800.167094:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787359800.167107:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359800.167113:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359800.167116:0:5885:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787359800.167119:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359800.167124:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359800.167125:0:5885:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787359800.167129:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787359800.167168:0:5885:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787359800.167194:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359800.167197:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359800.167199:0:5885:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787359800.167201:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359800.167204:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359800.167205:0:5885:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787359800.167208:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787359800.167210:0:5885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787359800.167253:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5885:1874182527780096:0@lo:502: 00000100:00100000:3.0:1787359800.167335:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359800.167406:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b55d8d4b going to sleep for 11 seconds 00000100:00100000:0.0:1787359800.169135:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780096 00000100:00100000:0.0:1787359800.169150:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780096 00000100:00100000:0.0:1787359800.169228:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787359800.169237:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0dfeed9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5885:x1874182527780096:12345-0@lo:502: 00000100:00100000:0.0:1787359800.169627:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0dfeed9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5885:x1874182527780096:12345-0@lo:502: Request processed in 390us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359800.169635:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787359800.169672:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5885:1874182527780096:0@lo:502: 00000020:01000000:3.0:1787359800.169749:0:5885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359800.169756:0:5885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359800.169758:0:5885:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787359800.169762:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787359800.169931:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787359800.169947:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787359800.169971:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.169990:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 00000000ef8cd893/0x72f6de40e4ef3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359800.169999:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d0dccf000 from 1 10000000:01000000:0.0:1787359800.170002:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787359800.170031:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.170039:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.170048:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359800.170065:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e8ae203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780224:0@lo:101: 00000100:00100000:0.0:1787359800.170112:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359800.170149:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bea621f going to sleep for 11 seconds 00000100:00100000:1.0:1787359800.170165:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780224 00000100:00100000:1.0:1787359800.170171:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780224 00000100:00100000:1.0:1787359800.170205:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787359800.170213:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec55d1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+9:5842:x1874182527780224:12345-0@lo:101: 00010000:00010000:1.0:1787359800.170222:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359800.170235:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef348a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.170254:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.170264:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.170273:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070633a9b, rc 0) 00000100:00100000:1.0:1787359800.170311:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec55d1c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+10:5842:x1874182527780224:12345-0@lo:101: Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359800.170317:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359800.170791:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e8ae203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780224:0@lo:101: 00010000:00010000:0.0:1787359800.170804:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.170812:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359800.171516:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e8ae203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780352:0@lo:256: 00000100:00100000:0.0:1787359800.171567:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359800.171612:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bea621f going to sleep for 11 seconds 00000100:00100000:1.0:1787359800.171664:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780352 00000100:00100000:1.0:1787359800.171671:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780352 00000100:00100000:1.0:1787359800.171753:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359800.171759:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000048a603b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+10:5842:x1874182527780352:12345-0@lo:256: 20000000:01000000:1.0:1787359800.171779:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787359800.171784:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787359800.171863:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000048a603b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+10:5842:x1874182527780352:12345-0@lo:256: Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359800.171871:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359800.171925:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e8ae203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780352:0@lo:256: 10000000:01000000:0.0:1787359800.173525:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787359800.173551:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.173563:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359800.174862:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d0dccf000 from 1 10000000:01000000:1.0:1787359800.174870:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359800.175074:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.175086:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.175096:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359800.175118:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000488676df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780480:0@lo:101: 00000100:00100000:1.0:1787359800.175187:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.175239:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000009df7fa46 going to sleep for 11 seconds 00000100:00100000:0.0:1787359800.175274:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780480 00000100:00100000:0.0:1787359800.175283:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780480 00000100:00100000:0.0:1787359800.175335:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359800.175344:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000014e0777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+10:5842:x1874182527780480:12345-0@lo:101: 00010000:00010000:0.0:1787359800.175356:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359800.175369:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3498 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.175403:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.175412:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.175420:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000703192a3, rc 0) 00000100:00100000:0.0:1787359800.175465:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000014e0777 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527780480:12345-0@lo:101: Request processed in 123us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359800.175472:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359800.175515:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000488676df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780480:0@lo:101: 00010000:00010000:1.0:1787359800.175528:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.175536:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359800.175600:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000488676df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780608:0@lo:501: 00000100:00100000:1.0:1787359800.175635:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.175655:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000009df7fa46 going to sleep for 11 seconds 00000100:00100000:0.0:1787359800.175753:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780608 00000100:00100000:0.0:1787359800.175758:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780608 00000100:00100000:0.0:1787359800.175787:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359800.175794:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ed84601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527780608:12345-0@lo:501: 00000100:00100000:1.0:1787359800.177731:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ed84601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527780608:12345-0@lo:501: Request processed in 1933us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359800.177744:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787359800.177968:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000488676df pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780608:0@lo:501: 00000100:00100000:3.0:1787359800.178015:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780736:0@lo:503: 00000100:00100000:3.0:1787359800.178060:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359800.178099:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b55d8d4b going to sleep for 11 seconds 00000100:00100000:0.0:1787359800.178769:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780736 00000100:00100000:0.0:1787359800.178777:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780736 00000100:00100000:1.0:1787359800.178865:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787359800.178874:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000101f5cd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527780736:12345-0@lo:503: 00000040:00080000:1.0:1787359800.178925:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787359800.179068:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000101f5cd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527780736:12345-0@lo:503: Request processed in 195us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359800.179077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359800.179140:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780736:0@lo:503: 00000040:00080000:3.0:1787359800.180334:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787359800.182732:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787359800.182772:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787359800.182797:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.182811:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359800.182868:0:5842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787359800.182871:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff983d0dccf000 10000000:01000000:1.0:1787359800.182873:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff983d0dccf000 10000000:01000000:1.0:1787359800.182877:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787359800.182883:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d0dccf000 from 1 10000000:01000000:1.0:1787359800.182886:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787359800.182927:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.182944:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.182974:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359800.182997:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000386b1b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780864:0@lo:101: 00000100:00100000:1.0:1787359800.183065:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.183115:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000009df7fa46 going to sleep for 11 seconds 00000100:00100000:2.0:1787359800.184085:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780864 00000100:00100000:2.0:1787359800.184094:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780864 00000100:00100000:2.0:1787359800.184146:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787359800.184154:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0ebd182 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527780864:12345-0@lo:101: 00010000:00010000:2.0:1787359800.184168:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359800.184181:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef34ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef34a6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.184203:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.184214:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cfa10e2e/0x72f6de40e4ef34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.184223:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cfa10e2e, rc 0) 00000100:00100000:2.0:1787359800.184287:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0ebd182 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5842:x1874182527780864:12345-0@lo:101: Request processed in 134us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359800.184302:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787359800.184386:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000386b1b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780864:0@lo:101: 00010000:00010000:1.0:1787359800.184403:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.184412:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359800.184470:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000386b1b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780992:0@lo:501: 00000100:00100000:1.0:1787359800.184498:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.184533:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000009df7fa46 going to sleep for 11 seconds 00000100:00100000:2.0:1787359800.187415:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527780992 00000100:00100000:2.0:1787359800.187432:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527780992 00000100:00100000:3.0:1787359800.191364:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359800.191380:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076ca6bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5842:x1874182527780992:12345-0@lo:501: 00000100:00100000:3.0:1787359800.191739:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076ca6bea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5842:x1874182527780992:12345-0@lo:501: Request processed in 362us (7239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359800.191747:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787359800.191783:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000386b1b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527780992:0@lo:501: 00000100:00100000:1.0:1787359800.191847:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000386b1b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527781120:0@lo:503: 00000100:00100000:1.0:1787359800.191898:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.191958:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000009df7fa46 going to sleep for 11 seconds 00000100:00100000:3.0:1787359800.194209:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781120 00000100:00100000:3.0:1787359800.194224:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781120 00000100:00100000:3.0:1787359800.194295:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787359800.194304:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036613eae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5842:x1874182527781120:12345-0@lo:503: 00000100:00100000:3.0:1787359800.194744:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036613eae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5842:x1874182527781120:12345-0@lo:503: Request processed in 441us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359800.194754:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787359800.194861:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000386b1b4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527781120:0@lo:503: 00000100:00100000:2.0:1787359800.195938:0:5890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8aa526b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5890:1874182527781248:0@lo:502: 00000100:00100000:2.0:1787359800.196006:0:5890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.196044:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781248 00000100:00100000:2.0:1787359800.196050:0:5890:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c150f6c going to sleep for 11 seconds 00000100:00100000:1.0:1787359800.196051:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781248 00000100:00100000:1.0:1787359800.196091:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359800.196099:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a2ded58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5890:x1874182527781248:12345-0@lo:502: 00000100:00100000:1.0:1787359800.196357:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a2ded58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5890:x1874182527781248:12345-0@lo:502: Request processed in 257us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359800.196371:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787359800.196547:0:5890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8aa526b pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5890:1874182527781248:0@lo:502: 00000020:01000004:2.0:1787359800.196605:0:5890:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787359800.196620:0:5890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001cbd68aa) 00000020:00000080:2.0:1787359800.196638:0:5890:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787359800.196782:0:5890:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003987fe23 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787359800.196787:0:5890:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003987fe23 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787359800.196789:0:5890:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003987fe23 4 00010000:00080000:2.0:1787359800.196819:0:5890:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b83fe0fe@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.114@tcp at head 00010000:00010000:3.0:1787359800.201108:0:5890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787359800.201312:0:5890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787359800.201350:0:5890:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787359800.201363:0:5890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72f6de40e4ef34bb 00000100:00080000:3.0:1787359800.201373:0:5890:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787359800.201378:0:5890:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b83fe0fe using connection 192.168.201.114@tcp/0@lo 00000100:00100000:3.0:1787359800.201411:0:5890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b7a9140c x1874182527781376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787359800.201438:0:5890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787359800.201741:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527781376:0@lo:38: 00000100:00100000:0.0:1787359800.201807:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359800.201983:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781376 00000100:00100000:3.0:1787359800.201990:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781376 00000100:00100000:3.0:1787359800.202025:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359800.202032:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e8ae203 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874182527781376:12345-0@lo:38: 00000100:00100000:3.0:1787359800.202090:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e8ae203 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874182527781376:12345-0@lo:38: Request processed in 56us (282us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787359800.202097:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359800.202109:0:5890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c05c9b97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5890:1874182527781504:0@lo:502: 00000100:00100000:3.0:1787359800.202135:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787359800.202142:0:3316:0:(import.c:65:import_set_state_nolock()) 00000000b83fe0fe lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787359800.202146:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787359800.202149:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527781376:0@lo:38: 00000100:00100000:0.0:1787359800.202150:0:5890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359800.202165:0:5890:0:(client.c:2715:ptlrpc_set_wait()) set 000000000db94470 going to sleep for 11 seconds 00000100:00100000:3.0:1787359800.202175:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781504 00000100:00100000:3.0:1787359800.202178:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781504 00000100:00100000:3.0:1787359800.202214:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787359800.202221:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097ffec94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5890:x1874182527781504:12345-0@lo:502: 00000100:00100000:3.0:1787359800.202422:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097ffec94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5890:x1874182527781504:12345-0@lo:502: Request processed in 201us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359800.202429:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787359800.202469:0:5890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c05c9b97 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:5890:1874182527781504:0@lo:502: 00000040:00080000:3.0:1787359800.202489:0:5890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787359800.204735:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787359800.204768:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359800.204786:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.204800:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 00000000c9a7256a/0x72f6de40e4ef34a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787359800.204851:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787359800.204854:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359800.204855:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359800.204856:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359800.204857:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359800.204858:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359800.204859:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359800.204860:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359800.204862:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359800.204863:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359800.204864:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359800.204865:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359800.204869:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787359800.204872:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787359800.204873:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359800.204874:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359800.204875:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359800.204876:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359800.204877:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359800.204878:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359800.204879:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359800.204880:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359800.204881:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359800.204881:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359800.204882:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787359800.204906:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787359800.204924:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e452a6ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527781632:0@lo:253: 00000100:00100000:0.0:1787359800.205066:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359800.205102:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781632 00000100:00100000:3.0:1787359800.205109:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781632 00000100:00100000:0.0:1787359800.205110:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000000db94470 going to sleep for 11 seconds 00000100:00100000:3.0:1787359800.205151:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787359800.205159:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdace35b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5842:x1874182527781632:12345-0@lo:253: 20000000:01000000:3.0:1787359800.205185:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787359800.205198:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787359800.277296:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787359800.277318:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787359800.277392:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787359800.277397:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787359800.277416:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.277436:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.277444:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.277483:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.277497:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 12 pid: 5853 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359800.277510:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f36a472f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1874182527781760:0@lo:104: 00000100:00100000:1.0:1787359800.277572:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359800.277632:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c2f4a8e going to sleep for 11 seconds 00000100:00100000:2.0:1787359800.277719:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781760 00000100:00100000:2.0:1787359800.277728:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781760 00000100:00100000:2.0:1787359800.277780:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359800.277789:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044b117a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5877:x1874182527781760:12345-0@lo:104: 00010000:00010000:2.0:1787359800.277800:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.277877:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787359800.277883:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044b117a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5877:x1874182527781760:12345-0@lo:104: Request processed in 96us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359800.277909:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787359800.277960:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359800.277965:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.277973:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071739272 already unused, calling callback (000000006f99f108) 10000000:00010000:0.0:1787359800.278041:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.278055:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359800.278060:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359800.278065:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359800.278092:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.278099:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359800.278114:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.278121:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: 0000000071739272/0x72f6de40e4ef348a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3491 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359800.278138:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359800.278140:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359800.278141:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359800.278200:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000287d652b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527781888:0@lo:103: 00000100:00100000:0.0:1787359800.278230:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359800.278382:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f36a472f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1874182527781760:0@lo:104: 00010000:00010000:3.0:1787359800.278399:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359800.281305:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527781888 00000100:00100000:2.0:1787359800.281319:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527781888 00010000:00010000:2.0:1787359800.281353:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 13 pid: 5853 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359800.281398:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359800.281406:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c0745c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3318:x1874182527781888:12345-0@lo:103: 00010000:00010000:2.0:1787359800.281419:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359800.281424:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 13 pid: 5853 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281434:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 13 pid: 5853 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281449:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070633a9b/0x72f6de40e4ef3491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef348a expref: 13 pid: 5853 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281465:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281472:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787359800.281487:0:5846:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004090747s 00010000:00010000:2.0:1787359800.281491:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281497:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281524:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281529:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281535:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003880af1f already unused, calling callback (0000000065106302) 00010000:00010000:2.0:1787359800.281538:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.281544:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.282342:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359800.282354:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.284473:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.284493:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003880af1f/0x72f6de40e4ef34c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359800.284518:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359800.284615:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c0745c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3318:x1874182527781888:12345-0@lo:103: Request processed in 3207us (6382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359800.284625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787359800.284803:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000287d652b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527781888:0@lo:103: 00000100:00100000:3.0:1787359800.298399:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdace35b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5842:x1874182527781632:12345-0@lo:253: Request processed in 93231us (93324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359800.298417:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787359800.301764:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e452a6ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:5842:1874182527781632:0@lo:253: 10000000:01000000:0.0:1787359800.301787:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787359800.301791:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787359800.301792:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787359800.301794:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787359800.301795:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787359800.301796:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787359800.301816:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787359800.301817:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787359800.301819:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787359800.301820:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787359800.301822:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787359800.301823:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787359800.301825:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787359800.301840:0:5842:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787359800.312517:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787359800.312969:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787359800.313182:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787359800.313347:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787359800.313529:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787359800.313744:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359800.323167:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359800.323364:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359800.323814:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359800.324115:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359800.324309:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359800.324524:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:1.0:1787359800.359391:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1787359800.412642:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787359800.512868:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787359800.513384:0:5896:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787359800.513389:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787359800.513549:0:5897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787359800.521200:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787359800.521399:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787359800.524464:0:5842:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787359800.524485:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787359800.524776:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787359800.529593:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787359800.530752:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787359800.533409:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787359800.533660:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787359800.535294:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787359800.540633:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787359800.540840:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787359800.541156:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787359800.541299:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787359800.541449:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787359800.541589:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787359800.542372:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787359800.542545:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787359800.542721:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787359800.543383:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787359800.543558:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787359800.543767:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787359800.544421:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787359800.544665:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787359800.544880:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787359800.545292:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787359800.545590:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787359800.545792:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787359800.546807:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787359800.547755:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787359800.548506:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787359800.548725:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787359800.549423:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787359800.549595:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787359800.549824:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787359800.550131:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787359800.550335:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787359800.550550:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787359800.550788:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787359800.551308:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787359800.551454:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787359800.551581:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787359800.552080:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787359800.596820:0:5897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1787359800.659418:0:5842:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787359800.659471:0:5842:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdef81ca7988 00100000:10000000:0.0:1787359800.659479:0:5842:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787359800.660334:0:5842:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787359800.660349:0:5842:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787359800.660360:0:5842:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787359800.660406:0:5842:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787359800.706919:0:5897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787359800.706996:0:5897:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787359800.707001:0:5897:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787359801.383269:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359802.409537:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359803.432652:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359804.457069:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787359804.841371:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787359804.841383:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d0dccf000 from 3 10000000:01000000:3.0:1787359804.841390:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787359804.841462:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.841487:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.841502:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359804.841532:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527782016:0@lo:101: 00000100:00100000:3.0:1787359804.841647:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359804.841734:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ccbfd13 going to sleep for 11 seconds 00000100:00100000:3.0:1787359804.841764:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782016 00000100:00100000:3.0:1787359804.841774:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782016 00000100:00100000:3.0:1787359804.842032:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787359804.842042:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086391627 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5858:x1874182527782016:12345-0@lo:101: 00010000:00010000:3.0:1787359804.842058:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359804.842080:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b593cb0/0x72f6de40e4ef34d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef34c9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.842121:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b593cb0/0x72f6de40e4ef34d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.842131:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b593cb0/0x72f6de40e4ef34d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.842141:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b593cb0, rc 0) 00000100:00100000:3.0:1787359804.842182:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086391627 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527782016:12345-0@lo:101: Request processed in 141us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359804.842188:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787359804.842310:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527782016:0@lo:101: 00010000:00010000:3.0:1787359804.842324:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.842333:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359804.842384:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527782144:0@lo:256: 00000100:00100000:3.0:1787359804.842412:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359804.842428:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ccbfd13 going to sleep for 11 seconds 00000100:00100000:3.0:1787359804.842440:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782144 00000100:00100000:3.0:1787359804.842443:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782144 00000100:00100000:3.0:1787359804.842463:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359804.842468:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb4e504d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527782144:12345-0@lo:256: 20000000:01000000:3.0:1787359804.842886:0:5853:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787359804.842905:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787359804.842908:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787359804.842986:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb4e504d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527782144:12345-0@lo:256: Request processed in 517us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359804.842993:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359804.843026:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7a9140c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527782144:0@lo:256: 10000000:01000000:3.0:1787359804.843065:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787359804.843072:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359804.843080:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: 000000004ac7993f/0x72f6de40e4ef34c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787359805.362166:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787359805.362182:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787359805.362186:0:36:0:(import.c:65:import_set_state_nolock()) 00000000b83fe0fe lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787359805.362204:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b83fe0fe using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787359805.362254:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e452a6ae x1874182527782272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787359805.362360:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e452a6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527782272:0@lo:38: 00000100:00100000:3.0:1787359805.362453:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359805.362783:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782272 00000100:00100000:0.0:1787359805.362795:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782272 00000100:00100000:0.0:1787359805.362843:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359805.362852:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a9140c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1874182527782272:12345-0@lo:38: 00010000:00080000:0.0:1787359805.362887:0:5863:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1787359805.362945:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72f6de40e4ef34d7 00000004:00100000:0.0:1787359805.363010:0:5863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787359805.363185:0:5863:0:(import.c:65:import_set_state_nolock()) 00000000782bcf3f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359805.363261:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a9140c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874182527782272:12345-0@lo:38: Request processed in 408us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359805.363270:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359805.363318:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e452a6ae x1874182527782272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787359805.363343:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787359805.363352:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787359805.363357:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787359805.363360:0:3316:0:(import.c:65:import_set_state_nolock()) 00000000b83fe0fe lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787359805.363365:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e452a6ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527782272:0@lo:38: 00010000:00010000:1.0:1787359805.481175:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359806.503017:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787359806.725293:0:6139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787359807.530665:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359808.554165:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359809.575016:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359810.476133:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cfda60e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527782528:0@lo:400: 00000100:00100000:0.0:1787359810.476203:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e747732a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527782400:0@lo:400: 00000100:00100000:3.0:1787359810.476240:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359810.476256:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359810.476808:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782400 00000100:00100000:2.0:1787359810.476819:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782400 00000100:00100000:2.0:1787359810.476875:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359810.476887:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000085be8db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3319:x1874182527782400:12345-0@lo:400: 00000100:00100000:2.0:1787359810.476953:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000085be8db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3319:x1874182527782400:12345-0@lo:400: Request processed in 68us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359810.476961:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787359810.477597:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782528 00000100:00100000:3.0:1787359810.477607:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782528 00000100:00100000:3.0:1787359810.477655:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359810.477663:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b029578 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527782528:12345-0@lo:400: 00000100:00100000:3.0:1787359810.477738:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b029578 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527782528:12345-0@lo:400: Request processed in 76us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359810.477745:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787359810.478586:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cfda60e3 x1874182527782528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359810.478604:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cfda60e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527782528:0@lo:400: 00000100:00100000:0.0:1787359810.484886:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e747732a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527782400:0@lo:400: 00010000:00010000:1.0:1787359810.599171:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359811.622994:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787359812.515990:0:6341:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfd333020 20000000:00000080:0.0:1787359812.516014:0:6341:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983d087c6400 uarg=0000000000000000 20000000:01000000:0.0:1787359812.516061:0:6341:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787359812.516069:0:6341:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787359812.516076:0:6341:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787359812.516442:0:6341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787359812.516458:0:6341:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787359812.523045:0:6341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787359812.523497:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787359812.523571:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787359812.523625:0:6341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787359812.523650:0:6341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787359812.523721:0:6341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.523750:0:6341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.523771:0:6341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.523827:0:6341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.523846:0:6341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 11 pid: 5853 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359812.523866:0:6341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e452a6ae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6341:1874182527782656:0@lo:104: 00000100:00100000:0.0:1787359812.523960:0:6341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359812.524050:0:6341:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093a743f4 going to sleep for 11 seconds 00000100:00100000:1.0:1787359812.524157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782656 00000100:00100000:1.0:1787359812.524169:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782656 00000100:00100000:1.0:1787359812.524234:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787359812.524244:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab5b4f7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:6341:x1874182527782656:12345-0@lo:104: 00010000:00010000:1.0:1787359812.524261:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.524330:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359812.524336:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab5b4f7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:6341:x1874182527782656:12345-0@lo:104: Request processed in 94us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359812.524354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787359812.524382:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359812.524388:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.524396:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000062a9c8e4 already unused, calling callback (000000006f99f108) 10000000:00010000:1.0:1787359812.524400:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.524422:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359812.524429:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359812.524435:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787359812.524470:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.524490:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359812.524512:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.524518:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: 0000000062a9c8e4/0x72f6de40e4ef3498 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef349f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.524540:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359812.524542:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359812.524544:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359812.524558:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e4a9c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527782784:0@lo:103: 00000100:00100000:1.0:1787359812.524592:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359812.524736:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782784 00000100:00100000:3.0:1787359812.524747:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782784 00010000:00010000:3.0:1787359812.524771:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 12 pid: 5853 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359812.524800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787359812.524807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a909f6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3317:x1874182527782784:12345-0@lo:103: 00010000:00010000:3.0:1787359812.524820:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359812.524825:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 12 pid: 5853 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524835:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 12 pid: 5853 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524853:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524861:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524877:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524884:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524891:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524897:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524903:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022fe7bc3 already unused, calling callback (0000000065106302) 00010000:00010000:3.0:1787359812.524913:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524920:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524929:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.524940:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359812.524976:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a909f6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3317:x1874182527782784:12345-0@lo:103: Request processed in 170us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359812.524983:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787359812.525051:0:6341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000703192a3/0x72f6de40e4ef349f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3498 expref: 11 pid: 5853 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359812.525063:0:6341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e452a6ae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6341:1874182527782656:0@lo:104: 00010000:00010000:3.0:1787359812.525082:0:6341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.525091:0:6341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.525096:0:6341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.525103:0:6341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022fe7bc3/0x72f6de40e4ef34de lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359812.526251:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e4a9c5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527782784:0@lo:103: 00010000:00010000:1.0:1787359812.648703:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787359812.753981:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787359812.753994:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d0dccf000 from 1 10000000:01000000:0.0:1787359812.754001:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359812.754089:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: 0000000022fe7bc3/0x72f6de40e4ef34e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.754107:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: 0000000022fe7bc3/0x72f6de40e4ef34e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.754122:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: 0000000022fe7bc3/0x72f6de40e4ef34e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359812.754154:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a56c4d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527782912:0@lo:101: 00000100:00100000:0.0:1787359812.754253:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359812.754321:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db4f5297 going to sleep for 11 seconds 00000100:00100000:3.0:1787359812.754378:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527782912 00000100:00100000:3.0:1787359812.754389:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527782912 00000100:00100000:3.0:1787359812.754484:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787359812.754494:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7e543e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:5858:x1874182527782912:12345-0@lo:101: 00010000:00010000:3.0:1787359812.754512:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359812.754529:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a106afe/0x72f6de40e4ef34ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef34e5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.754558:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a106afe/0x72f6de40e4ef34ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.754571:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a106afe/0x72f6de40e4ef34ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359812.754583:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a106afe, rc 0) 00000100:00100000:3.0:1787359812.754643:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7e543e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527782912:12345-0@lo:101: Request processed in 151us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359812.754651:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359812.754798:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a56c4d4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527782912:0@lo:101: 00010000:00010000:1.0:1787359812.754818:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: 0000000022fe7bc3/0x72f6de40e4ef34e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359812.754838:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: 0000000022fe7bc3/0x72f6de40e4ef34e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359812.754909:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e4a9c5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527783040:0@lo:501: 00000100:00100000:1.0:1787359812.754940:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359812.754971:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e7bd3058 going to sleep for 11 seconds 00000100:00100000:0.0:1787359812.755050:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783040 00000100:00100000:0.0:1787359812.755055:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783040 00000100:00100000:0.0:1787359812.755101:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787359812.755108:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002080e54a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527783040:12345-0@lo:501: 00000100:00100000:0.0:1787359812.755424:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002080e54a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527783040:12345-0@lo:501: Request processed in 317us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359812.755432:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787359812.755467:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e4a9c5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527783040:0@lo:501: 00000100:00100000:0.0:1787359812.755512:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cc0ef0c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527783168:0@lo:503: 00000100:00100000:0.0:1787359812.755558:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359812.755575:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000003812e8da going to sleep for 11 seconds 00000100:00100000:0.0:1787359812.755586:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783168 00000100:00100000:0.0:1787359812.755589:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783168 00000100:00100000:0.0:1787359812.755607:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787359812.755613:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007be4b960 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527783168:12345-0@lo:503: 00000100:00100000:0.0:1787359812.755781:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007be4b960 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527783168:12345-0@lo:503: Request processed in 167us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359812.755788:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787359812.755826:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cc0ef0c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527783168:0@lo:503: 00000100:00100000:0.0:1787359812.756033:0:6352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007cc0ef0c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6352:1874182527783296:0@lo:502: 00000100:00100000:0.0:1787359812.756067:0:6352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359812.756087:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783296 00000100:00100000:0.0:1787359812.756090:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783296 00000100:00100000:0.0:1787359812.756108:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359812.756114:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f68e156b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6352:x1874182527783296:12345-0@lo:502: 00000100:00100000:0.0:1787359812.756222:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f68e156b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6352:x1874182527783296:12345-0@lo:502: Request processed in 109us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359812.756238:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359812.756264:0:6352:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca92761c going to sleep for 11 seconds 00000100:00100000:0.0:1787359812.756275:0:6352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007cc0ef0c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6352:1874182527783296:0@lo:502: 00000020:01000000:0.0:1787359812.756295:0:6352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359812.756308:0:6352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359812.756311:0:6352:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787359812.756319:0:6352:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d0dccf000 00000020:00000080:0.0:1787359812.756322:0:6352:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787359812.756368:0:6352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6352:1874182527783424:0@lo:502: 00000100:00100000:0.0:1787359812.756401:0:6352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359812.756419:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783424 00000100:00100000:0.0:1787359812.756422:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783424 00000100:00100000:0.0:1787359812.756439:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787359812.756445:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6352:x1874182527783424:12345-0@lo:502: 00000100:00100000:0.0:1787359812.756541:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6352:x1874182527783424:12345-0@lo:502: Request processed in 96us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359812.756548:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787359812.756574:0:6352:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0dd71180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359812.756585:0:6352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6352:1874182527783424:0@lo:502: 00000020:01000000:0.0:1787359812.756602:0:6352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359812.756606:0:6352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359812.756608:0:6352:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787359812.756612:0:6352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787359812.756672:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787359812.756720:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359812.756730:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359812.756753:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359813.671133:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359814.695529:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359815.591335:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527783680:0@lo:400: 00000100:00100000:0.0:1787359815.591444:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359815.591540:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783680 00000100:00100000:0.0:1787359815.591551:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783680 00000100:00100000:0.0:1787359815.591612:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359815.591623:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527783680:12345-0@lo:400: 00000100:00100000:0.0:1787359815.591938:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527783680:12345-0@lo:400: Request processed in 314us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359815.591947:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359815.592002:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d1dc0e300 x1874182527783680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359815.592020:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527783680:0@lo:400: 00000100:00100000:1.0:1787359815.592149:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359815.592162:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527783552:0@lo:400: 00000100:00100000:1.0:1787359815.592205:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359815.593059:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783552 00000100:00100000:0.0:1787359815.593073:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783552 00000100:00100000:0.0:1787359815.593129:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787359815.593139:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3317:x1874182527783552:12345-0@lo:400: 00000100:00100000:0.0:1787359815.593212:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3317:x1874182527783552:12345-0@lo:400: Request processed in 75us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359815.593220:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787359815.593270:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527783552:0@lo:400: 00010000:00010000:1.0:1787359815.719910:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359816.743834:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359817.771244:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359818.795763:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359819.821884:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787359820.021823:0:6696:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787359820.021836:0:6696:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787359820.022008:0:6696:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff983d200eb000 00000020:01000004:2.0:1787359820.022030:0:6696:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787359820.022046:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787359820.022369:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff983d32c7cd28) 00000020:00000080:2.0:1787359820.022451:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787359820.062327:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787359820.066170:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787359820.125599:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787359820.141744:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787359820.141789:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787359820.141851:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787359820.141879:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787359820.142319:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787359820.142334:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787359820.142369:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72f6de40e4ef34fa 00000020:01000004:2.0:1787359820.142380:0:6696:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787359820.142410:0:6696:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787359820.142414:0:6696:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787359820.142421:0:6696:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787359820.142425:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787359820.142440:0:6696:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff983d32c78000) 00000020:00000080:2.0:1787359820.142452:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787359820.146076:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359820.146800:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787359820.146808:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787359820.158646:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787359820.158661:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787359820.162126:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787359820.162148:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787359820.171028:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359820.171275:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787359820.171282:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787359820.179139:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787359820.179159:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787359820.221671:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359820.222257:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787359820.222266:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787359820.224143:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787359820.224159:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787359820.226162:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787359820.226180:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787359820.230375:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787359820.230860:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787359820.230869:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787359820.232186:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787359820.232202:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787359820.314470:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787359820.314977:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787359820.314986:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787359820.318430:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787359820.318533:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787359820.324097:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787359820.324135:0:6696:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787359820.324143:0:6696:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787359820.345233:0:6696:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787359820.345278:0:6696:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.114@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787359820.345283:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787359820.345285:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787359820.345286:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787359820.345286:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787359820.345287:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787359820.345288:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787359820.345289:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787359820.345290:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787359820.345292:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787359820.345293:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787359820.345294:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787359820.345299:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787359820.345301:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787359820.345302:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787359820.345303:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787359820.345304:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787359820.345305:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787359820.345306:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787359820.345307:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787359820.345308:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787359820.345309:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787359820.345309:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787359820.345310:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787359820.345654:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787359820.345787:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527783808:0@lo:253: 00000100:00100000:3.0:1787359820.345878:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.345978:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.346058:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783808 00000100:00100000:0.0:1787359820.346067:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783808 00000100:00100000:0.0:1787359820.346136:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359820.346148:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527783808:12345-0@lo:253: 20000000:01000000:0.0:1787359820.346187:0:5853:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787359820.346193:0:5853:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787359820.346199:0:5853:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787359820.346287:0:5853:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787359820.347438:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787359820.347770:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787359820.347788:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787359820.347816:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787359820.347821:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787359820.347836:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787359820.347861:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787359820.348166:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787359820.348188:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.114@tcp 20000000:01000000:0.0:1787359820.348197:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.114@tcp (null) (null) (null) 00000040:00080000:0.0:1787359820.348322:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787359820.348332:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787359820.348393:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787359820.348402:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.114@tcp (null) (null) 00000040:00080000:0.0:1787359820.348432:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787359820.348441:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787359820.348531:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787359820.348568:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787359820.349554:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787359820.349576:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.114@tcp 20000000:01000000:0.0:1787359820.349578:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.114@tcp (null) (null) (null) 00000040:00080000:0.0:1787359820.349599:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787359820.349606:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787359820.349634:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787359820.349642:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.114@tcp (null) (null) 00000040:00080000:0.0:1787359820.349838:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787359820.349848:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787359820.349880:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787359820.349915:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787359820.349934:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787359820.349938:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787359820.349941:0:5853:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787359820.349957:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787359820.349960:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787359820.349995:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787359820.349998:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787359820.350598:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787359820.350824:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787359820.350869:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787359820.350931:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787359820.350942:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787359820.350943:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359820.351408:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359820.351449:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359820.351486:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787359820.351710:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787359820.351752:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787359820.351788:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787359820.351800:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787359820.351802:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359820.352385:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359820.352444:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359820.352559:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787359820.352874:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787359820.352895:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787359820.352931:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787359820.352944:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787359820.352945:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787359820.352955:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787359820.352979:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.352998:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.353004:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.353009:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.353014:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.353061:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.353075:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.353092:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1874182527783936:0@lo:104: 00000100:00100000:3.0:1787359820.353178:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.353306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527783936 00000100:00100000:0.0:1787359820.353315:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527783936 00000100:00100000:0.0:1787359820.353381:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359820.353393:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5853:x1874182527783936:12345-0@lo:104: 00010000:00010000:0.0:1787359820.353408:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.353493:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359820.353500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5853:x1874182527783936:12345-0@lo:104: Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.353507:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787359820.353709:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359820.353718:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.353743:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165b400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787359820.353748:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.353757:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359820.353764:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359820.353771:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359820.353810:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.353816:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787359820.353880:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527784064:0@lo:103: 00010000:00010000:2.0:1787359820.353906:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.353914:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165b400/0x72f6de40e4ef34a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.353932:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359820.353934:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359820.353935:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359820.353984:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.354002:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.354009:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1874182527784192:0@lo:104: 00000100:00100000:0.0:1787359820.354100:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359820.354147:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784064 00000100:00100000:2.0:1787359820.354162:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784064 00000100:00100000:3.0:1787359820.354176:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359820.354185:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 13 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359820.354261:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787359820.354275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3320:x1874182527784064:12345-0@lo:103: 00010000:00010000:2.0:1787359820.354288:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359820.354305:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 13 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.354318:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 13 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.354335:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359820.354354:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.354363:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 13 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.354372:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1874182527784320:0@lo:104: 00000100:00100000:3.0:1787359820.354394:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359820.354396:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3320:x1874182527784064:12345-0@lo:103: Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359820.354403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359820.354451:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401480 going to sleep for 11 seconds 00010000:00010000:3.0:1787359820.354484:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef34ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef34a6 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.354498:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1874182527783936:0@lo:104: 00000100:00100000:0.0:1787359820.354570:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784192 00000100:00100000:0.0:1787359820.354574:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784192 00000100:00100000:1.0:1787359820.354580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784320 00000100:00100000:1.0:1787359820.354584:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784320 00000100:00100000:0.0:1787359820.354596:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359820.354603:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:5853:x1874182527784192:12345-0@lo:104: 00010000:00010000:0.0:1787359820.354612:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.354716:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359820.354722:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:5853:x1874182527784192:12345-0@lo:104: Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.354728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359820.354743:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359820.354750:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5853:x1874182527784320:12345-0@lo:104: 00010000:00010000:1.0:1787359820.354755:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359820.354761:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.354765:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.354769:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01484400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787359820.354773:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.354780:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.354798:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787359820.354804:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5853:x1874182527784320:12345-0@lo:104: Request processed in 54us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.354810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787359820.354873:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1874182527784192:0@lo:104: 00000100:00100000:3.0:1787359820.354882:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1874182527784320:0@lo:104: 00010000:00010000:3.0:1787359820.354912:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359820.355424:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527784064:0@lo:103: 10000000:00010000:1.0:1787359820.355431:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.355442:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1787359820.355449:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359820.355538:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.355545:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359820.355567:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.355574:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01484400/0x72f6de40e4ef3436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef343d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.355588:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359820.355590:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359820.355591:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359820.355616:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a03a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527784448:0@lo:103: 00000100:00100000:1.0:1787359820.355660:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359820.355766:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784448 00000100:00100000:2.0:1787359820.355773:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784448 00010000:00010000:2.0:1787359820.355797:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359820.355829:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787359820.355837:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3317:x1874182527784448:12345-0@lo:103: 00010000:00010000:2.0:1787359820.355846:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359820.355850:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.355862:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.355878:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef343d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3436 expref: 12 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.355898:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359820.355977:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+11:3317:x1874182527784448:12345-0@lo:103: Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359820.355984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787359820.356092:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359820.356094:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359820.356096:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359820.356134:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a03a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527784448:0@lo:103: 00010000:00010000:1.0:1787359820.356667:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.356675:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00031800 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787359820.356713:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.356724:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359820.356732:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359820.356752:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787359820.357498:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357508:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359820.357535:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357543:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef341a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3421 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357563:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359820.357565:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359820.357567:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359820.357575:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359820.357590:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527784576:0@lo:103: 00000100:00100000:1.0:1787359820.357655:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359820.357743:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784576 00000100:00100000:1.0:1787359820.357751:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784576 00010000:00010000:1.0:1787359820.357779:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 11 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359820.357807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359820.357814:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:3317:x1874182527784576:12345-0@lo:103: 00010000:00010000:1.0:1787359820.357826:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359820.357831:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 11 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357843:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 11 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357868:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3421 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef341a expref: 11 pid: 5855 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357883:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357890:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357906:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357913:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357920:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357925:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357931:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01484e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359820.357935:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357943:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357957:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.357979:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359820.358015:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+10:3317:x1874182527784576:12345-0@lo:103: Request processed in 201us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.358021:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359820.358061:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527784576:0@lo:103: 00010000:00010000:1.0:1787359820.358394:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.358404:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.358410:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01484e00/0x72f6de40e4ef3508 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787359820.358426:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787359820.434364:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+9:6696:x1874182527783808:12345-0@lo:253: Request processed in 88194us (88461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.434382:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359820.434557:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527783808:0@lo:253: 10000000:01000000:3.0:1787359820.434578:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787359820.434668:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787359820.434670:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787359820.434671:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787359820.434673:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787359820.434674:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787359820.434698:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787359820.434700:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787359820.434702:0:6696:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787359820.434703:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787359820.434705:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787359820.434730:0:6696:0:(tgt_mount.c:101:server_register_mount()) register mount ffff983d200eb000 from lustre-OST0000 10000000:01000000:3.0:1787359820.434759:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787359820.434762:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787359820.434771:0:6696:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff983d111f3370 local copy 10000000:01000000:3.0:1787359820.434775:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787359820.434827:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.434838:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.434849:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.434870:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527784704:0@lo:101: 00000100:00100000:3.0:1787359820.434991:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.435113:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.435765:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784704 00000100:00100000:0.0:1787359820.435777:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784704 00000100:00100000:2.0:1787359820.436022:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787359820.436035:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+9:6696:x1874182527784704:12345-0@lo:101: 00010000:00010000:2.0:1787359820.436054:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359820.436079:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676000/0x72f6de40e4ef3516 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef350f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.436111:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676000/0x72f6de40e4ef3516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef350f expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.436123:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676000/0x72f6de40e4ef3516 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef350f expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.436133:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676000, rc 0) 00000100:00100000:2.0:1787359820.436214:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+10:6696:x1874182527784704:12345-0@lo:101: Request processed in 181us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359820.436220:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787359820.436319:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527784704:0@lo:101: 00010000:00010000:3.0:1787359820.436349:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.436360:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.436545:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527784832:0@lo:501: 00000100:00100000:3.0:1787359820.436580:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.436944:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.437410:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784832 00000100:00100000:0.0:1787359820.437419:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784832 00000100:00100000:0.0:1787359820.437552:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359820.437565:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+10:6696:x1874182527784832:12345-0@lo:501: 00000100:00100000:0.0:1787359820.437943:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+10:6696:x1874182527784832:12345-0@lo:501: Request processed in 379us (1360us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787359820.437952:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787359820.438214:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527784832:0@lo:501: 10000000:01000000:3.0:1787359820.438241:0:6696:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787359820.438284:0:6696:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787359820.438293:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.438305:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.438313:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.438349:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787359820.438377:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff983d200eb000 10000000:01000000:3.0:1787359820.438382:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787359820.438388:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff983d111f3370 10000000:01000000:3.0:1787359820.438390:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787359820.438394:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff983d111f3370 from 1 10000000:01000000:3.0:1787359820.438397:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787359820.438429:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.438437:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.438460:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.438609:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527784960:0@lo:101: 00000100:00100000:3.0:1787359820.438654:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.438718:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35b240 going to sleep for 11 seconds 00010000:00010000:0.0:1787359820.438828:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359820.438836:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.438844:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01485c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787359820.438849:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.438858:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359820.438865:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359820.438945:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359820.438970:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.438976:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359820.439008:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.439016:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef350f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x72f6de40e4ef3516 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.439037:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359820.439039:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359820.439041:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359820.439054:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359820.439069:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527785088:0@lo:103: 00000100:00100000:0.0:1787359820.439106:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.439151:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527784960 00000100:00100000:0.0:1787359820.439158:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527784960 00000100:00100000:0.0:1787359820.439196:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787359820.439269:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+10:6696:x1874182527784960:12345-0@lo:101: 00010000:00010000:0.0:1787359820.439285:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359820.439303:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d00031400/0x72f6de40e4ef3524 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef351d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.439329:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d00031400/0x72f6de40e4ef3524 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef351d expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.439351:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d00031400/0x72f6de40e4ef3524 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef351d expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.439370:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d00031400, rc 0) 00000100:00100000:0.0:1787359820.439408:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527784960:12345-0@lo:101: Request processed in 204us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.439416:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787359820.439734:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527784960:0@lo:101: 00010000:00010000:3.0:1787359820.439749:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.439758:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359820.439777:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787359820.439796:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.439804:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359820.439811:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787359820.439816:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787359820.439822:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787359820.439824:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787359820.439844:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.439850:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.439866:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.439881:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785216:0@lo:101: 00000100:00100000:3.0:1787359820.439990:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.440015:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.440103:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785216 00000100:00100000:0.0:1787359820.440109:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785216 00000100:00100000:0.0:1787359820.440144:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787359820.440152:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785216:12345-0@lo:101: 00010000:00010000:0.0:1787359820.440161:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359820.440173:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef352b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.440188:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.440197:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.440559:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d00031e00, rc 0) 00000100:00100000:0.0:1787359820.440726:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527785216:12345-0@lo:101: Request processed in 574us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.440733:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787359820.440845:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785216:0@lo:101: 00010000:00010000:3.0:1787359820.440859:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.440868:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.441072:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785344:0@lo:501: 00000100:00100000:3.0:1787359820.441104:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.441145:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.441334:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785344 00000100:00100000:0.0:1787359820.441350:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785344 00000100:00100000:0.0:1787359820.441392:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787359820.441400:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527785344:12345-0@lo:501: 00000100:00100000:0.0:1787359820.442108:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527785344:12345-0@lo:501: Request processed in 707us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.442127:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787359820.442247:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785088 00000100:00100000:1.0:1787359820.442255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785088 00000100:00100000:1.0:1787359820.442308:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787359820.442317:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3320:x1874182527785088:12345-0@lo:103: 00010000:00010000:1.0:1787359820.442330:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359820.442363:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef3516 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef350f expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.442388:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359820.442433:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:3320:x1874182527785088:12345-0@lo:103: Request processed in 117us (3326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.442445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359820.442635:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527785088:0@lo:103: 00000100:00100000:3.0:1787359820.443160:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785344:0@lo:501: 00000100:00100000:3.0:1787359820.443284:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785472:0@lo:503: 00000100:00100000:3.0:1787359820.443361:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.443446:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359820.443557:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785472 00000100:00100000:2.0:1787359820.443564:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785472 00000100:00100000:2.0:1787359820.443815:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787359820.443826:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785472:12345-0@lo:503: 00000100:00100000:2.0:1787359820.444286:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785472:12345-0@lo:503: Request processed in 460us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359820.444296:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787359820.448825:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785472:0@lo:503: 00000040:00080000:3.0:1787359820.453735:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787359820.453962:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785600:0@lo:502: 00000100:00100000:3.0:1787359820.454066:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.454136:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.454323:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785600 00000100:00100000:0.0:1787359820.454334:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785600 00000100:00100000:0.0:1787359820.454401:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787359820.454412:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785600:12345-0@lo:502: 00000100:00100000:0.0:1787359820.455178:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785600:12345-0@lo:502: Request processed in 765us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.455188:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359820.455318:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785600:0@lo:502: 00000040:00080000:3.0:1787359820.457300:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787359820.457416:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787359820.457454:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787359820.457666:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787359820.458422:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787359820.458836:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787359820.458970:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785728:0@lo:502: 00000100:00100000:0.0:1787359820.459079:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.459195:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401480 going to sleep for 11 seconds 00000100:00100000:3.0:1787359820.459364:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785728 00000100:00100000:3.0:1787359820.459375:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785728 00000100:00100000:3.0:1787359820.459483:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787359820.459495:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785728:12345-0@lo:502: 00000100:00100000:3.0:1787359820.459862:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785728:12345-0@lo:502: Request processed in 367us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359820.459871:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787359820.460039:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785728:0@lo:502: 00000040:00080000:0.0:1787359820.460190:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787359820.460281:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787359820.461027:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787359820.461037:0:6715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787359820.461046:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359820.461049:0:6715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787359820.461061:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787359820.461082:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff983d11010000) 00000020:00000080:0.0:1787359820.461108:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787359820.461114:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787359820.461201:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d200eb000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787359820.461226:0:6715:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787359820.461238:0:6715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72f6de40e4ef3540 00010000:00010000:1.0:1787359820.468160:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787359820.468968:0:6715:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787359820.472015:0:6715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787359820.473148:0:6715:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1787359820.483423:0:6715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787359820.486930:0:6715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787359820.490457:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787359820.490540:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359820.490549:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359820.490552:0:6715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787359820.490558:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359820.490563:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359820.490565:0:6715:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787359820.490568:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787359820.490570:0:6715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787359820.490796:0:6715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359820.490800:0:6715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359820.490802:0:6715:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787359820.490805:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787359820.498007:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787359820.498071:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787359820.498104:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.498120:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359820.498130:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d200eb000 from 1 10000000:01000000:0.0:1787359820.498133:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359820.498185:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.498194:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.498335:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359820.498378:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785856:0@lo:101: 00000100:00100000:0.0:1787359820.498665:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.498861:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359820.514009:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785856 00000100:00100000:3.0:1787359820.514032:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785856 00000100:00100000:3.0:1787359820.514140:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787359820.514154:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+11:6696:x1874182527785856:12345-0@lo:101: 00010000:00010000:3.0:1787359820.514177:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359820.514534:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3547 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.514580:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.514593:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.514616:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01484400, rc 0) 00000100:00100000:3.0:1787359820.515010:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527785856:12345-0@lo:101: Request processed in 857us (16538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359820.515041:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787359820.523649:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785856:0@lo:101: 00010000:00010000:0.0:1787359820.523791:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.523808:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359820.524015:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785984:0@lo:501: 00000100:00100000:0.0:1787359820.524111:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.524353:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359820.524836:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527785984 00000100:00100000:3.0:1787359820.524846:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527785984 00000100:00100000:2.0:1787359820.525061:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787359820.525076:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527785984:12345-0@lo:501: 00000100:00100000:2.0:1787359820.527373:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527785984:12345-0@lo:501: Request processed in 2288us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359820.527392:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787359820.530029:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527785984:0@lo:501: 00000100:00100000:0.0:1787359820.530118:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786112:0@lo:503: 00000100:00100000:0.0:1787359820.530287:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.530401:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359820.530542:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786112 00000100:00100000:2.0:1787359820.530550:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786112 00000100:00100000:2.0:1787359820.531021:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787359820.531036:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786112:12345-0@lo:503: 00000100:00100000:2.0:1787359820.531832:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786112:12345-0@lo:503: Request processed in 796us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359820.531843:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787359820.532160:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786112:0@lo:503: 00000040:00080000:1.0:1787359820.533146:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787359820.533426:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786240:0@lo:502: 00000100:00100000:1.0:1787359820.533570:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359820.533758:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0de27f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787359820.534152:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786240 00000100:00100000:2.0:1787359820.534171:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786240 00000100:00100000:3.0:1787359820.534411:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359820.534423:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786240:12345-0@lo:502: 00000100:00100000:3.0:1787359820.535065:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786240:12345-0@lo:502: Request processed in 642us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359820.535074:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787359820.535214:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786240:0@lo:502: 00000040:00080000:1.0:1787359820.535516:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787359820.535579:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787359820.535629:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786368:0@lo:502: 00000100:00100000:1.0:1787359820.535704:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359820.536624:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d2012b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787359820.537128:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786368 00000100:00100000:0.0:1787359820.537139:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786368 00000100:00100000:0.0:1787359820.537193:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787359820.537273:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786368:12345-0@lo:502: 00000100:00100000:0.0:1787359820.537742:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786368:12345-0@lo:502: Request processed in 538us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359820.537751:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787359820.538098:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786368:0@lo:502: 00000040:00080000:1.0:1787359820.538902:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787359820.538925:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787359820.544165:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359820.544186:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359820.544189:0:6719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787359820.544198:0:6719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d200eb000 00000020:00000080:3.0:1787359820.544212:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787359820.544240:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359820.544243:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359820.544244:0:6719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787359820.544247:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787359820.545015:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787359820.545054:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359820.545084:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.545100:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359820.545151:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787359820.545155:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff983d200eb000 10000000:01000000:0.0:1787359820.545159:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff983d200eb000 10000000:01000000:0.0:1787359820.545163:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359820.545184:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d200eb000 from 1 10000000:01000000:0.0:1787359820.545187:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359820.545358:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.545369:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.545384:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359820.545415:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786496:0@lo:101: 00000100:00100000:0.0:1787359820.545579:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.545783:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.545878:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786496 00000100:00100000:1.0:1787359820.545959:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786496 00000100:00100000:1.0:1787359820.546020:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787359820.546032:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527786496:12345-0@lo:101: 00010000:00010000:1.0:1787359820.546049:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359820.546075:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3555 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.546105:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.546116:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.546126:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a600, rc 0) 00000100:00100000:1.0:1787359820.546171:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786496:12345-0@lo:101: Request processed in 142us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.546179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787359820.546387:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786496:0@lo:101: 00010000:00010000:0.0:1787359820.546404:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359820.546413:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359820.546766:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786624:0@lo:501: 00000100:00100000:0.0:1787359820.546807:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.546840:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.546994:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786624 00000100:00100000:1.0:1787359820.547000:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786624 00000100:00100000:1.0:1787359820.547120:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787359820.547129:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786624:12345-0@lo:501: 00000100:00100000:1.0:1787359820.547649:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786624:12345-0@lo:501: Request processed in 520us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.547658:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787359820.548015:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786624:0@lo:501: 00000100:00100000:0.0:1787359820.548062:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786752:0@lo:503: 00000100:00100000:0.0:1787359820.548115:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.548186:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.548293:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786752 00000100:00100000:1.0:1787359820.548299:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786752 00000100:00100000:1.0:1787359820.548325:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787359820.548332:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786752:12345-0@lo:503: 00000100:00100000:1.0:1787359820.548551:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786752:12345-0@lo:503: Request processed in 219us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.548559:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787359820.548804:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786752:0@lo:503: 00000040:00080000:0.0:1787359820.549256:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787359820.549366:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786880:0@lo:502: 00000100:00100000:0.0:1787359820.549419:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359820.549464:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.549796:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527786880 00000100:00100000:1.0:1787359820.549804:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527786880 00000100:00100000:1.0:1787359820.549846:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787359820.549854:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786880:12345-0@lo:502: 00000100:00100000:1.0:1787359820.550092:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527786880:12345-0@lo:502: Request processed in 238us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.550101:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787359820.550295:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527786880:0@lo:502: 00000040:00080000:0.0:1787359820.550785:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787359820.550846:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787359820.550877:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787359820.551092:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787359820.551134:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787359820.551181:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787359820.551869:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787359820.551998:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787359820.552089:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787359820.552127:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787359820.552156:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787359820.552269:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787359820.552311:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787359820.552353:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787359820.552404:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787359820.552441:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787359820.552549:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787359820.553006:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787359820.553081:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787359820.553114:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787359820.553185:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787359820.553297:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787359820.553333:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787359820.553395:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787359820.553433:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787359820.553540:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787359820.553592:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787359820.553972:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787359820.554043:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527787008:0@lo:502: 00000100:00100000:2.0:1787359820.554161:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359820.554347:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0831f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.566398:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787008 00000100:00100000:1.0:1787359820.566419:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787008 00000100:00100000:1.0:1787359820.566544:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787359820.566555:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527787008:12345-0@lo:502: 00000100:00100000:1.0:1787359820.567138:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527787008:12345-0@lo:502: Request processed in 582us (12976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.567147:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359820.567412:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527787008:0@lo:502: 00000040:00080000:2.0:1787359820.567565:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787359820.567581:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787359820.569380:0:6720:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787359820.569425:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff983d3f653370) 00000020:00000080:1.0:1787359820.569878:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787359820.570082:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d200eb000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787359820.570087:0:6720:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d200eb000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787359820.570091:0:6720:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d200eb000 3 00010000:00080000:1.0:1787359820.570131:0:6720:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d3f63e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.114@tcp at head 00010000:00010000:1.0:1787359820.574206:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787359820.574970:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787359820.575022:0:6720:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787359820.575039:0:6720:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72f6de40e4ef356a 00000100:00080000:1.0:1787359820.575053:0:6720:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359820.575060:0:6720:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff983d3f63e800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787359820.575109:0:6720:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3a039f80 x1874182527787136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787359820.575139:0:6720:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787359820.575367:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1874182527787136:0@lo:38: 00000100:00100000:0.0:1787359820.575490:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359820.575939:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787359820.575952:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527787264:0@lo:400: 00000100:00100000:1.0:1787359820.575997:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359820.576058:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787136 00000100:00100000:1.0:1787359820.576066:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787136 00000100:00100000:1.0:1787359820.576107:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787264 00000100:00100000:1.0:1787359820.576110:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787264 00000100:00100000:1.0:1787359820.576140:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787359820.576150:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527787264:12345-0@lo:400: 00000100:00100000:1.0:1787359820.576386:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527787264:12345-0@lo:400: Request processed in 237us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.576395:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787359820.576414:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787359820.576419:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874182527787136:12345-0@lo:38: 00010000:00080000:1.0:1787359820.576669:0:5861:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:1.0:1787359820.576742:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72f6de40e4ef3571 00000004:00100000:1.0:1787359820.576763:0:5861:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787359820.576808:0:5861:0:(import.c:65:import_set_state_nolock()) ffff983d39d9c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359820.576859:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874182527787136:12345-0@lo:38: Request processed in 439us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.576866:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787359820.577088:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d3a038380 x1874182527787264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359820.577105:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527787264:0@lo:400: 00010000:00080000:1.0:1787359820.577145:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d3a039f80 x1874182527787136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359820.577170:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787359820.577178:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787359820.577188:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787359820.577192:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787359820.577195:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d3f63e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787359820.577322:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1874182527787136:0@lo:38: 00000040:00080000:1.0:1787359820.578105:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787359820.585608:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787359820.585666:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359820.585737:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.585751:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787359820.585844:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787359820.585846:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787359820.585848:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359820.585850:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359820.585852:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359820.585853:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359820.585855:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359820.585857:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359820.585858:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359820.585860:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359820.585862:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787359820.585866:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787359820.585869:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787359820.585871:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787359820.585872:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359820.585873:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359820.585874:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359820.585875:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359820.585876:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359820.585876:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359820.585877:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359820.585878:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359820.585879:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787359820.585927:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787359820.585952:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527787392:0@lo:253: 00000100:00100000:2.0:1787359820.586045:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359820.586104:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0831f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.586902:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787392 00000100:00100000:1.0:1787359820.586915:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787392 00000100:00100000:1.0:1787359820.586982:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787359820.586995:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6696:x1874182527787392:12345-0@lo:253: 20000000:01000000:1.0:1787359820.587032:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787359820.587050:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787359820.690146:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787359820.690172:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787359820.690302:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787359820.690309:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787359820.690349:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.690374:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.690384:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.690439:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359820.690477:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 13 pid: 5855 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359820.690496:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1874182527787520:0@lo:104: 00000100:00100000:3.0:1787359820.690602:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359820.690715:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f35b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359820.691942:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787520 00000100:00100000:1.0:1787359820.691957:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787520 00000100:00100000:1.0:1787359820.692469:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787359820.692486:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5877:x1874182527787520:12345-0@lo:104: 00010000:00010000:1.0:1787359820.692508:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.692636:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359820.692644:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5877:x1874182527787520:12345-0@lo:104: Request processed in 162us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.692651:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359820.692954:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1874182527787520:0@lo:104: 00010000:00010000:0.0:1787359820.692983:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.695807:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359820.695825:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.695919:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01484200 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787359820.695924:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.695936:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359820.695943:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359820.695949:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359820.696010:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.696017:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359820.696041:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.696049:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01484200/0x72f6de40e4ef34c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34d0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359820.696214:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527787648:0@lo:103: 00000100:00100000:0.0:1787359820.696307:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359820.696439:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359820.696442:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359820.696444:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359820.696598:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787648 00000100:00100000:1.0:1787359820.696617:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787648 00010000:00010000:1.0:1787359820.696651:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 14 pid: 5855 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359820.696751:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787359820.696774:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3317:x1874182527787648:12345-0@lo:103: 00010000:00010000:1.0:1787359820.696790:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359820.696797:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 14 pid: 5855 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696808:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 14 pid: 5855 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696824:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01485000/0x72f6de40e4ef34d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef34c9 expref: 14 pid: 5855 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696841:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696860:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787359820.696877:0:5848:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006568801s 00010000:00010000:1.0:1787359820.696882:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696889:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696896:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696912:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696918:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01485c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359820.696923:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696930:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696949:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359820.696961:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359820.697010:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3317:x1874182527787648:12345-0@lo:103: Request processed in 238us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.697017:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787359820.697267:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.697278:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359820.697296:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01485c00/0x72f6de40e4ef3578 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359820.697815:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527787648:0@lo:103: 00000100:00100000:1.0:1787359820.706393:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:6696:x1874182527787392:12345-0@lo:253: Request processed in 119319us (120266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359820.706417:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359820.706942:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:6696:1874182527787392:0@lo:253: 10000000:01000000:2.0:1787359820.706965:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787359820.706969:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787359820.706970:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787359820.706972:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359820.706974:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359820.706975:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359820.706976:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359820.706978:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359820.706980:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359820.706981:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359820.706983:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359820.706985:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787359820.707004:0:6696:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787359820.714943:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359820.716617:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359820.717091:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359820.718860:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359820.719169:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359820.720971:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787359820.726974:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787359820.838921:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787359820.954161:0:6696:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787359820.954171:0:6696:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787359820.954264:0:6696:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787359820.954326:0:6696:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787359820.954356:0:6696:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787359820.954389:0:6696:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787359821.862878:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359822.886916:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359823.911458:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359824.934827:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359825.833531:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527787776:0@lo:400: 00000100:00100000:1.0:1787359825.833539:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a03a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527787904:0@lo:400: 00000100:00100000:1.0:1787359825.835518:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359825.835614:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787359825.835630:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527788032:0@lo:400: 00000100:00100000:1.0:1787359825.835663:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359825.835856:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787904 00000100:00100000:2.0:1787359825.835866:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787904 00000100:00100000:2.0:1787359825.835922:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788032 00000100:00100000:2.0:1787359825.835925:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788032 00000100:00100000:2.0:1787359825.835958:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787359825.835968:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527787904:12345-0@lo:400: 00000100:00100000:2.0:1787359825.841983:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527787904:12345-0@lo:400: Request processed in 5997us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359825.842004:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787359825.842059:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787359825.842075:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527788032:12345-0@lo:400: 00000100:00100000:2.0:1787359825.842153:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527788032:12345-0@lo:400: Request processed in 86us (6488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359825.842160:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787359825.844399:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3a038700 x1874182527788032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359825.844432:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527788032:0@lo:400: 00010000:00080000:1.0:1787359825.844455:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3a03a680 x1874182527787904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359825.844464:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a03a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527787904:0@lo:400: 00000100:00080000:1.0:1787359825.844548:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359825.856524:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359825.856673:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527787776 00000100:00100000:1.0:1787359825.857002:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527787776 00000100:00100000:1.0:1787359825.857062:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787359825.857074:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3318:x1874182527787776:12345-0@lo:400: 00000100:00100000:1.0:1787359825.857166:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3318:x1874182527787776:12345-0@lo:400: Request processed in 93us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359825.857175:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787359825.857557:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527787776:0@lo:400: 00010000:00010000:3.0:1787359825.958907:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787359826.344050:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787359826.344059:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d0dccf000 from 21 10000000:01000000:3.0:1787359826.344065:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787359826.344115:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.344128:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.344141:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359826.344166:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788160:0@lo:101: 00000100:00100000:3.0:1787359826.344264:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.344319:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359826.344402:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788160 00000100:00100000:1.0:1787359826.344410:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788160 00000100:00100000:1.0:1787359826.344474:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787359826.344485:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527788160:12345-0@lo:101: 00010000:00010000:1.0:1787359826.344497:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359826.344510:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef357f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359826.344532:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359826.344542:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359826.344562:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165bc00, rc 0) 00000100:00100000:1.0:1787359826.344601:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527788160:12345-0@lo:101: Request processed in 118us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359826.344608:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787359826.344727:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788160:0@lo:101: 00010000:00010000:3.0:1787359826.344742:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.344761:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359826.344818:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788288:0@lo:501: 00000100:00100000:3.0:1787359826.344856:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.344879:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359826.345161:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788288 00000100:00100000:1.0:1787359826.345167:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788288 00000100:00100000:1.0:1787359826.345200:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787359826.345208:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527788288:12345-0@lo:501: 00000100:00100000:1.0:1787359826.345490:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527788288:12345-0@lo:501: Request processed in 282us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359826.345497:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787359826.346790:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788288:0@lo:501: 00000100:00100000:3.0:1787359826.346858:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788416:0@lo:503: 00000100:00100000:3.0:1787359826.346914:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.346950:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787359826.347366:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788416 00000100:00100000:2.0:1787359826.347373:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788416 00000100:00100000:2.0:1787359826.347422:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787359826.347432:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527788416:12345-0@lo:503: 00000100:00100000:2.0:1787359826.347636:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527788416:12345-0@lo:503: Request processed in 204us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359826.347644:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787359826.349824:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788416:0@lo:503: 00000100:00100000:0.0:1787359826.358162:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6931:1874182527788544:0@lo:502: 00000100:00100000:0.0:1787359826.358274:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.358317:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d096ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.358345:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788544 00000100:00100000:0.0:1787359826.358352:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788544 00000100:00100000:0.0:1787359826.358393:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787359826.358403:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6931:x1874182527788544:12345-0@lo:502: 00000100:00100000:0.0:1787359826.358641:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6931:x1874182527788544:12345-0@lo:502: Request processed in 239us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.358649:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787359826.358757:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6931:1874182527788544:0@lo:502: 00000100:00100000:0.0:1787359826.358807:0:6931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6931:1874182527788672:0@lo:502: 00000100:00100000:0.0:1787359826.358843:0:6931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.358857:0:6931:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359826.358937:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788672 00000100:00100000:3.0:1787359826.358942:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788672 00000100:00100000:3.0:1787359826.358974:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787359826.358981:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6931:x1874182527788672:12345-0@lo:502: 00000100:00100000:3.0:1787359826.359111:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:6931:x1874182527788672:12345-0@lo:502: Request processed in 130us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359826.359118:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787359826.360461:0:6931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6931:1874182527788672:0@lo:502: 00000040:00080000:0.0:1787359826.360503:0:6931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787359826.364127:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787359826.364168:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787359826.364200:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364213:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359826.364225:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787359826.364228:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d0dccf000 from 4 10000000:01000000:3.0:1787359826.364231:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787359826.364310:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364320:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364332:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359826.364358:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788800:0@lo:101: 00000100:00100000:3.0:1787359826.364431:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.364469:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787359826.364498:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788800 00000100:00100000:3.0:1787359826.364504:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788800 00000100:00100000:3.0:1787359826.364549:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787359826.364559:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527788800:12345-0@lo:101: 00010000:00010000:3.0:1787359826.364574:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359826.364589:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef358d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364610:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364627:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364637:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01484200, rc 0) 00000100:00100000:3.0:1787359826.364694:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527788800:12345-0@lo:101: Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359826.364701:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787359826.364750:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788800:0@lo:101: 00010000:00010000:3.0:1787359826.364764:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359826.364774:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359826.364820:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788928:0@lo:256: 00000100:00100000:3.0:1787359826.368674:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.368748:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.376601:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527788928 00000100:00100000:0.0:1787359826.376617:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527788928 00000100:00100000:0.0:1787359826.376709:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787359826.376720:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527788928:12345-0@lo:256: 20000000:01000000:0.0:1787359826.376749:0:5853:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787359826.376767:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787359826.376770:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787359826.376926:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527788928:12345-0@lo:256: Request processed in 207us (8277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.376940:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787359826.377001:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527788928:0@lo:256: 10000000:01000000:0.0:1787359826.377055:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787359826.377065:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377077:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359826.377087:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787359826.377090:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787359826.377093:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787359826.377123:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377131:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377140:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359826.377158:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789056:0@lo:101: 00000100:00100000:0.0:1787359826.377190:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.377212:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.377227:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789056 00000100:00100000:0.0:1787359826.377231:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789056 00000100:00100000:0.0:1787359826.377265:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787359826.377272:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527789056:12345-0@lo:101: 00010000:00010000:0.0:1787359826.377289:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359826.377303:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef359b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377326:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377336:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377345:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d00030000, rc 0) 00000100:00100000:0.0:1787359826.377375:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527789056:12345-0@lo:101: Request processed in 103us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.377381:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787359826.377413:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789056:0@lo:101: 00010000:00010000:0.0:1787359826.377426:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.377435:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359826.377482:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789184:0@lo:501: 00000100:00100000:0.0:1787359826.377506:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.377519:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.377530:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789184 00000100:00100000:0.0:1787359826.377534:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789184 00000100:00100000:0.0:1787359826.377556:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787359826.377562:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527789184:12345-0@lo:501: 00000100:00100000:0.0:1787359826.377893:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527789184:12345-0@lo:501: Request processed in 330us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.377901:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787359826.377932:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789184:0@lo:501: 00000100:00100000:0.0:1787359826.377961:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789312:0@lo:503: 00000100:00100000:0.0:1787359826.378002:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.378017:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.378029:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789312 00000100:00100000:0.0:1787359826.378033:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789312 00000100:00100000:0.0:1787359826.378055:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787359826.378062:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527789312:12345-0@lo:503: 00000100:00100000:0.0:1787359826.378268:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527789312:12345-0@lo:503: Request processed in 205us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.378275:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787359826.378313:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789312:0@lo:503: 00000100:00100000:0.0:1787359826.378503:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6933:1874182527789440:0@lo:502: 00000100:00100000:0.0:1787359826.378536:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.378555:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789440 00000100:00100000:0.0:1787359826.378559:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789440 00000100:00100000:0.0:1787359826.378579:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359826.378584:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:6933:x1874182527789440:12345-0@lo:502: 00000100:00100000:0.0:1787359826.378788:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:6933:x1874182527789440:12345-0@lo:502: Request processed in 202us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.378795:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359826.378821:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e2583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.378838:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6933:1874182527789440:0@lo:502: 00000020:01000000:0.0:1787359826.378858:0:6933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787359826.378866:0:6933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787359826.378872:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359826.378874:0:6933:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787359826.378878:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787359826.378881:0:6933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.114@tcp to nid 0x20000c0a8c972 (192.168.201.114@tcp) 00000020:01000000:0.0:1787359826.378904:0:6933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787359826.378907:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787359826.378922:0:6933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff983d110119b8) 00000020:00000080:0.0:1787359826.378944:0:6933:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787359826.378950:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787359826.379030:0:6933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787359826.379036:0:6933:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787359826.379043:0:6933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef35b0 00010000:00080000:0.0:1787359826.379074:0:6933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983c02487800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.114@tcp at head 00010000:00010000:0.0:1787359826.379336:0:6933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787359826.489383:0:6933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787359826.489410:0:6933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787359826.493110:0:6933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787359826.493387:0:6933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787359826.493450:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787359826.493517:0:6933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787359826.494369:0:6950:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787359826.494375:0:6950:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787359826.496120:0:6933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787359826.496138:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787359826.496179:0:6933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787359826.496205:0:6933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef35b7 00000100:00080000:0.0:1787359826.496220:0:6933:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787359826.496227:0:6933:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff983c02487800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787359826.496283:0:6933:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d1dc0c380 x1874182527789568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787359826.496300:0:6933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787359826.496368:0:6933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359826.496373:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359826.496375:0:6933:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787359826.496378:0:6933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359826.496382:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359826.496384:0:6933:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787359826.496387:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787359826.496389:0:6933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787359826.496419:0:6933:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6933:1874182527789696:0@lo:502: 00000100:00100000:1.0:1787359826.496427:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527789568:0@lo:8: 00000100:00100000:1.0:1787359826.500465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.502198:0:6933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.502283:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789568 00000100:00100000:0.0:1787359826.502292:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789568 00000100:00100000:0.0:1787359826.502333:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359826.502342:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1874182527789568:12345-0@lo:8: 00010000:00080000:0.0:1787359826.502372:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1787359826.502539:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef35be 00002000:00100000:0.0:1787359826.502581:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff983c02483000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787359826.502586:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787359826.502591:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787359826.503043:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787359826.503295:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787359826.503327:0:6698:0:(import.c:65:import_set_state_nolock()) ffff983c02484800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359826.503409:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874182527789568:12345-0@lo:8: Request processed in 1066us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.503419:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787359826.503470:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789696 00000100:00100000:0.0:1787359826.503476:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789696 00000100:00100000:0.0:1787359826.503507:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787359826.503515:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:6933:x1874182527789696:12345-0@lo:502: 00000100:00100000:1.0:1787359826.505924:0:6933:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e258000 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.507202:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:6933:x1874182527789696:12345-0@lo:502: Request processed in 3682us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.507216:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787359826.507306:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1dc0c380 x1874182527789568/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787359836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359826.507319:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787359826.507328:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787359826.507336:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787359826.507342:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787359826.507345:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983c02487800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787359826.507357:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787359826.507363:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527789568:0@lo:8: 00000100:00100000:1.0:1787359826.508003:0:6933:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:6933:1874182527789696:0@lo:502: 00000020:01000000:1.0:1787359826.508038:0:6933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359826.508045:0:6933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359826.508047:0:6933:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359826.508052:0:6933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787359826.509280:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787359826.509306:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787359826.509317:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.509329:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359826.509339:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787359826.509341:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff983d111f3370 from 1 10000000:01000000:0.0:1787359826.509345:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787359826.509379:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.509394:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.509406:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359826.509430:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789824:0@lo:101: 00000100:00100000:0.0:1787359826.509495:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.509534:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e258f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.511165:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789824 00000100:00100000:0.0:1787359826.511178:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789824 00000100:00100000:0.0:1787359826.511229:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787359826.511260:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527789824:12345-0@lo:101: 00010000:00010000:0.0:1787359826.511277:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359826.511309:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef35c5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.511339:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.511350:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.511360:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41a00, rc 0) 00000100:00100000:0.0:1787359826.511436:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527789824:12345-0@lo:101: Request processed in 197us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359826.511444:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787359826.511559:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789824:0@lo:101: 00010000:00010000:0.0:1787359826.511584:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.511594:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787359826.511937:0:6950:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787359826.512583:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789952:0@lo:501: 00000100:00100000:0.0:1787359826.512640:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.512828:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527789952 00000100:00100000:0.0:1787359826.513088:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527789952 00000100:00100000:0.0:1787359826.513183:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787359826.513192:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527789952:12345-0@lo:501: 00000100:00100000:0.0:1787359826.513423:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527789952:12345-0@lo:501: Request processed in 231us (782us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787359826.513432:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787359826.513496:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e258f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.513517:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527789952:0@lo:501: 10000000:01000000:0.0:1787359826.513553:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787359826.513562:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359826.513572:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787359826.514898:0:6950:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200843217897ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787359826.580902:0:6951:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787359826.580938:0:6951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790208:0@lo:7: 00000100:00100000:0.0:1787359826.581013:0:6951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359826.581086:0:6951:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359826.581124:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359826.581135:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527790080:0@lo:13: 00000100:00100000:0.0:1787359826.581162:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.581638:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790208 00000100:00100000:3.0:1787359826.581647:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790208 00000100:00100000:3.0:1787359826.581721:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787359826.581732:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6951:x1874182527790208:12345-0@lo:7: 00000100:00100000:2.0:1787359826.588714:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790080 00000100:00100000:2.0:1787359826.588728:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790080 00000100:00100000:2.0:1787359826.588786:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359826.588804:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874182527790080:12345-0@lo:13: 00002000:00000024:2.0:1787359826.588840:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787359826.588933:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874182527790080:12345-0@lo:13: Request processed in 136us (7768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359826.588940:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787359826.588994:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1dc0c380 x1874182527790080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359826.589014:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527790080:0@lo:13: 00000100:00080000:3.0:1787359826.621413:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787359826.622702:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787359826.622712:0:6701:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787359826.622817:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6951:x1874182527790208:12345-0@lo:7: Request processed in 41082us (41798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359826.622829:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787359826.622896:0:6951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1dc0fb80 x1874182527790208/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787359842 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359826.622913:0:6951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790208:0@lo:7: 00000004:00080000:3.0:1787359826.622929:0:6951:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787359826.622968:0:6951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790336:0@lo:5: 00000100:00100000:3.0:1787359826.623002:0:6951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.623043:0:6951:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359826.623062:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790336 00000100:00100000:3.0:1787359826.623068:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790336 00000100:00100000:3.0:1787359826.623118:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359826.623128:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6951:x1874182527790336:12345-0@lo:5: 00002000:00080000:3.0:1787359826.623154:0:6700:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787359826.623157:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787359826.623375:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6951:x1874182527790336:12345-0@lo:5: Request processed in 248us (372us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787359826.623382:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787359826.623413:0:6951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643f100 x1874182527790336/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359842 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359826.623425:0:6951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790336:0@lo:5: 00000004:00080000:3.0:1787359826.624184:0:6951:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787359826.624223:0:6951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790464:0@lo:700: 00000100:00100000:3.0:1787359826.624276:0:6951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.624303:0:6951:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359826.624337:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790464 00000100:00100000:3.0:1787359826.624341:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790464 00000100:00100000:3.0:1787359826.624387:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359826.624404:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6951:x1874182527790464:12345-0@lo:700: 00000100:00100000:3.0:1787359826.625573:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1874182527790592:0@lo:700: 00000100:00100000:3.0:1787359826.625636:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.625667:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787359826.626298:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790592 00000100:00100000:1.0:1787359826.626308:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790592 00000100:00100000:1.0:1787359826.626351:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787359826.626360:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1874182527790592:12345-0@lo:700: 00000004:00080000:2.0:1787359826.663528:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787359826.736212:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1787359826.750514:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1874182527790592:12345-0@lo:700: Request processed in 124143us (124866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359826.750538:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787359826.750602:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643ea00 x1874182527790592/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787359842 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359826.750620:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1874182527790592:0@lo:700: 40000000:02000000:1.0:1787359826.750635:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1787359826.888357:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787359826.888383:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787359826.889249:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6951:x1874182527790464:12345-0@lo:700: Request processed in 264840us (264965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359826.889267:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787359826.889402:0:6951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643c700 x1874182527790464/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787359842 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359826.889415:0:6951:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787359826.889444:0:6951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790464:0@lo:700: 00000004:02000040:3.0:1787359826.967331:0:6951:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787359826.971607:0:6951:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790720:0@lo:5: 00000100:00100000:3.0:1787359826.971849:0:6951:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359826.971906:0:6951:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359826.972049:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790720 00000100:00100000:1.0:1787359826.972057:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790720 00000100:00100000:1.0:1787359826.972124:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787359826.972135:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6951:x1874182527790720:12345-0@lo:5: 00010000:00010000:1.0:1787359826.983235:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787359826.986992:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787359826.987015:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787359826.992460:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6951:x1874182527790720:12345-0@lo:5: Request processed in 20318us (20602us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787359826.992475:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787359826.995103:0:6951:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643c700 x1874182527790720/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359842 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359826.995127:0:6951:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6951:1874182527790720:0@lo:5: 00000004:00080000:1.0:1787359826.995145:0:6951:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787359828.007276:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359828.670800:0:7070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787359829.030982:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359830.055001:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359831.079005:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359831.982180:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527790848:0@lo:13: 00000100:00100000:2.0:1787359831.982284:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359831.982433:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790848 00000100:00100000:1.0:1787359831.982444:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790848 00000100:00100000:1.0:1787359831.982531:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787359831.982545:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527790848:12345-0@lo:13: 00002000:00000024:1.0:1787359831.982595:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359831.982653:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527790848:12345-0@lo:13: Request processed in 111us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359831.982672:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787359831.983725:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527790976:0@lo:400: 00000100:00100000:3.0:1787359831.983792:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359831.983840:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359831.983846:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527791104:0@lo:400: 00000100:00100000:3.0:1787359831.983871:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359831.983931:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527791232:0@lo:400: 00000100:00100000:3.0:1787359831.983959:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359831.984033:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527790976 00000100:00100000:3.0:1787359831.984041:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527790976 00000100:00100000:3.0:1787359831.984084:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787359831.984093:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527790976:12345-0@lo:400: 00000100:00100000:3.0:1787359831.984155:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527790976:12345-0@lo:400: Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359831.984163:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787359831.984214:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527790976:0@lo:400: 00000100:00080000:2.0:1787359831.984286:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359831.984317:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3a038700 x1874182527790848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359831.984339:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527790848:0@lo:13: 00000100:00100000:2.0:1787359831.984363:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791104 00000100:00100000:2.0:1787359831.984366:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791104 00000100:00100000:2.0:1787359831.984402:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791232 00000100:00100000:2.0:1787359831.984406:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791232 00000100:00100000:2.0:1787359831.984430:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359831.984435:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527791104:12345-0@lo:400: 00000100:00100000:2.0:1787359831.984483:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527791104:12345-0@lo:400: Request processed in 48us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359831.984489:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359831.984506:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359831.984513:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527791232:12345-0@lo:400: 00000100:00100000:2.0:1787359831.984546:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527791232:12345-0@lo:400: Request processed in 33us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359831.984551:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787359831.984567:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787359831.984587:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643ea00 x1874182527791232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359831.984598:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527791232:0@lo:400: 00010000:00080000:2.0:1787359831.984638:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643d880 x1874182527791104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359831.984648:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527791104:0@lo:400: 00010000:00010000:2.0:1787359832.106670:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787359832.139450:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787359833.131288:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359834.150945:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359835.185074:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359836.199043:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359837.095900:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527791744:0@lo:400: 00000100:00100000:3.0:1787359837.096026:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a03bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527791360:0@lo:400: 00000100:00100000:3.0:1787359837.096113:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359837.096232:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359837.096273:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527791616:0@lo:400: 00000100:00100000:1.0:1787359837.096303:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359837.096325:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359837.096332:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527791488:0@lo:400: 00000100:00100000:1.0:1787359837.096353:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359837.096384:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791616 00000100:00100000:1.0:1787359837.096394:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791616 00000100:00100000:1.0:1787359837.096460:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791488 00000100:00100000:1.0:1787359837.096463:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791488 00000100:00100000:1.0:1787359837.096484:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787359837.096493:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527791616:12345-0@lo:400: 00000100:00100000:3.0:1787359837.096591:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791744 00000100:00100000:3.0:1787359837.096596:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791744 00000100:00100000:3.0:1787359837.096627:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787359837.096634:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527791744:12345-0@lo:400: 00000100:00100000:3.0:1787359837.096720:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527791744:12345-0@lo:400: Request processed in 84us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359837.096728:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787359837.096779:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3a039c00 x1874182527791744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359837.096793:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787359837.096815:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527791744:0@lo:400: 00000100:00100000:1.0:1787359837.096955:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527791616:12345-0@lo:400: Request processed in 453us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359837.096963:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787359837.096978:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787359837.096985:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527791488:12345-0@lo:400: 00000100:00100000:1.0:1787359837.097013:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527791488:12345-0@lo:400: Request processed in 30us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359837.097020:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787359837.097043:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359837.097050:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359837.097336:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791360 00000100:00100000:0.0:1787359837.097345:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791360 00000100:00100000:0.0:1787359837.097386:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787359837.097394:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3318:x1874182527791360:12345-0@lo:400: 00000100:00100000:0.0:1787359837.097441:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3318:x1874182527791360:12345-0@lo:400: Request processed in 48us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359837.097449:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787359837.097491:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a03bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527791360:0@lo:400: 00000100:00100000:0.0:1787359837.098123:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527791872:0@lo:13: 00000100:00100000:0.0:1787359837.098166:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359837.098215:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527791872 00000100:00100000:0.0:1787359837.098221:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527791872 00000100:00100000:0.0:1787359837.098257:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359837.098264:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527791872:12345-0@lo:13: 00002000:00000024:0.0:1787359837.098304:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359837.098344:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527791872:12345-0@lo:13: Request processed in 80us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359837.098352:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787359837.098389:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1dc0fb80 x1874182527791872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359837.098428:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527791872:0@lo:13: 00010000:00080000:3.0:1787359837.104233:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3a039880 x1874182527791616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359837.104283:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527791616:0@lo:400: 00010000:00080000:3.0:1787359837.104442:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3a038000 x1874182527791488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359837.104453:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527791488:0@lo:400: 00010000:00010000:0.0:1787359837.239629:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359838.247789:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359839.272734:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359840.297943:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359841.326156:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787359841.750093:0:7632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787359841.750097:0:7632:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787359841.750238:0:7632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff983d11588000 00000020:01000004:2.0:1787359841.750257:0:7632:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787359841.750270:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787359841.750293:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff983d39bf19b8) 00000020:00000080:2.0:1787359841.750310:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787359841.783364:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787359841.785318:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787359841.802647:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787359841.807416:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787359841.807453:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787359841.807513:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787359841.807540:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787359841.808044:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787359841.808057:0:7632:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787359841.808068:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72f6de40e4ef35da 00000020:01000004:1.0:1787359841.808077:0:7632:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787359841.808098:0:7632:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.114@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787359841.808102:0:7632:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787359841.808108:0:7632:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787359841.808130:0:7632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787359841.808135:0:7632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787359841.823665:0:7632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787359841.823725:0:7632:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.114@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787359841.823730:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787359841.823732:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787359841.823734:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359841.823735:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787359841.823736:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359841.823737:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359841.823739:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787359841.823741:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787359841.823742:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787359841.823744:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359841.823746:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787359841.823750:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787359841.823752:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787359841.823758:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787359841.823759:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359841.823760:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787359841.823761:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359841.823762:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359841.823763:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787359841.823764:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787359841.823764:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787359841.823765:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359841.823766:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787359841.823800:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787359841.823817:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527792000:0@lo:253: 00000100:00100000:1.0:1787359841.823959:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.824090:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.824146:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792000 00000100:00100000:3.0:1787359841.824154:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792000 00000100:00100000:3.0:1787359841.824250:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787359841.824260:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:7632:x1874182527792000:12345-0@lo:253: 20000000:01000000:3.0:1787359841.824288:0:5855:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787359841.824292:0:5855:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787359841.824298:0:5855:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787359841.824301:0:5855:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787359841.825312:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787359841.825536:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787359841.825549:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787359841.825586:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787359841.825594:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787359841.825624:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787359841.825718:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787359841.826118:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787359841.826137:0:5855:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.114@tcp 20000000:01000000:3.0:1787359841.826139:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.114@tcp (null) (null) (null) 00000040:00080000:3.0:1787359841.826171:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787359841.826178:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787359841.826221:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787359841.826229:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.114@tcp (null) (null) 00000040:00080000:3.0:1787359841.826258:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787359841.826274:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787359841.826307:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787359841.826355:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787359841.827076:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787359841.827092:0:5855:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.114@tcp 20000000:01000000:3.0:1787359841.827094:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.114@tcp (null) (null) (null) 00000040:00080000:3.0:1787359841.827914:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787359841.827927:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787359841.827967:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787359841.827985:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.114@tcp (null) (null) 00000040:00080000:3.0:1787359841.828018:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787359841.828028:0:5855:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787359841.828099:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787359841.828140:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787359841.828157:0:5855:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787359841.828160:0:5855:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787359841.828163:0:5855:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787359841.828174:0:5855:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787359841.828177:0:5855:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787359841.828211:0:5855:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787359841.828214:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359841.829069:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359841.829149:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359841.829185:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787359841.829594:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787359841.829631:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787359841.829803:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787359841.829816:0:5855:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787359841.829819:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359841.830387:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359841.830435:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359841.830564:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787359841.830989:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787359841.831032:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787359841.831068:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787359841.831081:0:5855:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787359841.831083:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787359841.831598:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787359841.831649:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787359841.831801:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787359841.832139:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787359841.832179:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787359841.832251:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787359841.832264:0:5855:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787359841.832267:0:5855:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787359841.832802:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787359841.833126:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787359841.833161:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787359841.833215:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787359841.833230:0:5855:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787359841.833233:0:5855:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787359841.833241:0:5855:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787359841.833262:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833281:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833289:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833297:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833304:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833311:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833319:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833363:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833392:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 16 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.833409:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792128:0@lo:104: 00000100:00100000:3.0:1787359841.833561:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359841.833668:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833710:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 16 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.833720:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792256:0@lo:104: 00010000:00010000:3.0:1787359841.833749:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833756:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 16 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.833764:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792384:0@lo:104: 00010000:00010000:3.0:1787359841.833787:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833794:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 16 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.833802:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792512:0@lo:104: 00010000:00010000:3.0:1787359841.833826:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.833921:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 16 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.833931:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792640:0@lo:104: 00000100:00100000:3.0:1787359841.833954:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f7f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787359841.834216:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787359841.834238:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.834299:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.834351:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359841.834372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792128 00000100:00100000:2.0:1787359841.834382:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792128 00000100:00100000:2.0:1787359841.834418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792256 00000100:00100000:2.0:1787359841.834422:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792256 00000100:00100000:2.0:1787359841.834433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792384 00000100:00100000:2.0:1787359841.834435:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792384 00000100:00100000:2.0:1787359841.834461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359841.834470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d200fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5855:x1874182527792128:12345-0@lo:104: 00010000:00010000:2.0:1787359841.834483:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.834983:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792128:0@lo:104: 00010000:00010000:2.0:1787359841.835078:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787359841.835086:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d200fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5855:x1874182527792128:12345-0@lo:104: Request processed in 617us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.835094:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359841.835138:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787359841.835146:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:5855:x1874182527792256:12345-0@lo:104: 00010000:00010000:2.0:1787359841.835153:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.835231:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792256:0@lo:104: 00000100:00100000:1.0:1787359841.835301:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.835312:0:5845:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787359841.835318:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787359841.835614:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792512 00000100:00100000:3.0:1787359841.835619:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792512 00000100:00100000:3.0:1787359841.835648:0:5845:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787359841.835654:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792640 00000100:00100000:3.0:1787359841.835656:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792640 00000100:00100000:1.0:1787359841.835828:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787359841.835848:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+6:5855:x1874182527792384:12345-0@lo:104: 00010000:00010000:1.0:1787359841.835858:0:7638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.835963:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792384:0@lo:104: 00010000:00010000:0.0:1787359841.836131:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787359841.836139:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836147:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00030a00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787359841.836151:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836160:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359841.836169:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359841.836176:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359841.836220:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836237:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359841.836257:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836264:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef35c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35cc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836275:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787359841.836279:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836285:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00030e00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787359841.836288:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836294:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359841.836300:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359841.836306:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359841.836319:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836324:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359841.836328:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836335:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00030e00/0x72f6de40e4ef359b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35a2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836347:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359841.836350:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836356:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01485c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787359841.836359:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836366:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359841.836371:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359841.836376:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359841.836387:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836392:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359841.836404:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836410:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01485c00/0x72f6de40e4ef357f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3586 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.836420:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359841.836422:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359841.836424:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359841.836626:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787359841.836636:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+6:5855:x1874182527792256:12345-0@lo:104: Request processed in 1489us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.836650:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787359841.836673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787359841.836694:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5855:x1874182527792512:12345-0@lo:104: 00010000:00010000:2.0:1787359841.836703:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.836754:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787359841.836759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:5855:x1874182527792512:12345-0@lo:104: Request processed in 67us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.836764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787359841.836777:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787359841.836783:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:5855:x1874182527792640:12345-0@lo:104: 00010000:00010000:2.0:1787359841.836789:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.836816:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787359841.836821:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:5855:x1874182527792640:12345-0@lo:104: Request processed in 39us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.836826:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787359841.836924:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787359841.836930:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.836937:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00030c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359841.836940:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.836946:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359841.836952:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359841.836957:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359841.836994:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837001:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359841.837007:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837014:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00030c00/0x72f6de40e4ef3555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef355c expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837025:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787359841.837027:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837033:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01484e00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359841.837036:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837042:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359841.837048:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359841.837053:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359841.837066:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837072:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359841.837076:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837092:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01484e00/0x72f6de40e4ef352b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3532 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.837107:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359841.837109:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359841.837111:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359841.837142:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643dc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792512:0@lo:104: 00000100:00100000:3.0:1787359841.837151:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5855:1874182527792640:0@lo:104: 00010000:00010000:3.0:1787359841.837179:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.837214:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359841.837320:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359841.837347:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787359841.837355:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5855:x1874182527792384:12345-0@lo:104: Request processed in 1519us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.837362:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359841.837534:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527792768:0@lo:103: 00000100:00100000:0.0:1787359841.837591:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359841.837662:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527793280:0@lo:103: 00000100:00100000:0.0:1787359841.837713:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359841.837955:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359841.837963:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527792896:0@lo:103: 00000100:00100000:0.0:1787359841.837997:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.838021:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792768 00000100:00100000:1.0:1787359841.838029:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792768 00010000:00010000:1.0:1787359841.838059:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 17 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.838130:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793280 00000100:00100000:1.0:1787359841.838135:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793280 00010000:00010000:1.0:1787359841.838163:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 18 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359841.838200:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359841.838211:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:3319:x1874182527792768:12345-0@lo:103: 00010000:00010000:2.0:1787359841.838225:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359841.838230:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 18 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.838242:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 18 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.838262:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f41a00/0x72f6de40e4ef35cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef35c5 expref: 18 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.838277:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359841.838305:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3319:x1874182527792768:12345-0@lo:103: Request processed in 97us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.838311:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359841.838325:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787359841.838330:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527793280:12345-0@lo:103: 00010000:00010000:2.0:1787359841.838337:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359841.838341:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 16 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.838349:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 16 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.838359:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00031e00/0x72f6de40e4ef3532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef352b expref: 16 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.838367:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359841.838387:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:3319:x1874182527793280:12345-0@lo:103: Request processed in 57us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.838392:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787359841.838618:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527792768:0@lo:103: 00000100:00100000:0.0:1787359841.838626:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527793280:0@lo:103: 00000100:00100000:0.0:1787359841.838657:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527793024:0@lo:103: 00000100:00100000:0.0:1787359841.838748:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359841.838830:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359841.838847:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527793152:0@lo:103: 00000100:00100000:0.0:1787359841.838869:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359841.838892:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359841.838986:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527792896 00000100:00100000:3.0:1787359841.838991:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527792896 00010000:00010000:3.0:1787359841.839012:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 15 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.839027:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793024 00000100:00100000:3.0:1787359841.839029:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793024 00010000:00010000:3.0:1787359841.839041:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 16 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.839051:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793152 00000100:00100000:3.0:1787359841.839054:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793152 00010000:00010000:3.0:1787359841.839063:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 17 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359841.839075:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787359841.839080:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3319:x1874182527792896:12345-0@lo:103: 00010000:00010000:3.0:1787359841.839098:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359841.839103:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 17 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839112:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 17 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839124:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00030000/0x72f6de40e4ef35a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef359b expref: 17 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839136:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359841.839179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527792896:12345-0@lo:103: Request processed in 99us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.839186:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787359841.839200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787359841.839206:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:3317:x1874182527793024:12345-0@lo:103: 00010000:00010000:3.0:1787359841.839213:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359841.839217:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 15 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839225:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 15 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef3586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef357f expref: 15 pid: 5853 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839245:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359841.839270:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3317:x1874182527793024:12345-0@lo:103: Request processed in 64us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.839275:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787359841.839301:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787359841.839306:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3317:x1874182527793152:12345-0@lo:103: 00010000:00010000:3.0:1787359841.839314:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359841.839318:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 13 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839326:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 13 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839336:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef355c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3555 expref: 13 pid: 5855 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839347:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839355:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839370:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839378:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839385:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839391:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839397:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787359841.839402:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839416:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839433:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359841.839549:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527792896:0@lo:103: 00000100:00100000:0.0:1787359841.839575:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527793024:0@lo:103: 00010000:00010000:3.0:1787359841.839609:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359841.839644:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3317:x1874182527793152:12345-0@lo:103: Request processed in 337us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.839650:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787359841.839672:0:5855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839701:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.839707:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef35e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787359841.839722:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787359841.839818:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527793152:0@lo:103: 00000100:00100000:0.0:1787359841.878747:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+11:7632:x1874182527792000:12345-0@lo:253: Request processed in 54478us (54778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.878762:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787359841.878890:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527792000:0@lo:253: 10000000:01000000:1.0:1787359841.878907:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787359841.878911:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787359841.878912:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787359841.878914:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787359841.878915:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787359841.878916:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787359841.878918:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787359841.878920:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787359841.878921:0:7632:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787359841.878923:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787359841.878924:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787359841.878954:0:7632:0:(tgt_mount.c:101:server_register_mount()) register mount ffff983d11588000 from lustre-OST0001 10000000:01000000:1.0:1787359841.878987:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787359841.878990:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787359841.879000:0:7632:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff983d111f3370 local copy 10000000:01000000:1.0:1787359841.879004:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787359841.879039:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.879050:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.879060:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.879077:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793408:0@lo:101: 00000100:00100000:1.0:1787359841.879131:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.879221:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787359841.879356:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793408 00000100:00100000:2.0:1787359841.879361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793408 00000100:00100000:2.0:1787359841.879450:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787359841.879460:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+11:7632:x1874182527793408:12345-0@lo:101: 00010000:00010000:2.0:1787359841.879471:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359841.879491:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676600/0x72f6de40e4ef35ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef35e8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.879514:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676600/0x72f6de40e4ef35ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef35e8 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.879525:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676600/0x72f6de40e4ef35ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef35e8 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.879534:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676600, rc 0) 00000100:00100000:2.0:1787359841.879577:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527793408:12345-0@lo:101: Request processed in 118us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.879583:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787359841.879638:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793408:0@lo:101: 00010000:00010000:1.0:1787359841.879652:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.879661:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.879781:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793536:0@lo:501: 00000100:00100000:1.0:1787359841.879807:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.880085:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.880154:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793536 00000100:00100000:0.0:1787359841.880158:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793536 00000100:00100000:0.0:1787359841.880183:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787359841.880190:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527793536:12345-0@lo:501: 00000100:00100000:0.0:1787359841.880416:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527793536:12345-0@lo:501: Request processed in 226us (607us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787359841.880424:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787359841.880549:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793536:0@lo:501: 10000000:01000000:1.0:1787359841.880564:0:7632:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787359841.880591:0:7632:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787359841.880597:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.880605:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.880611:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.880639:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787359841.880656:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff983d11588000 10000000:01000000:1.0:1787359841.880661:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787359841.880666:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787359841.880673:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787359841.880702:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787359841.880705:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787359841.880723:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.880731:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.880740:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.880752:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793664:0@lo:101: 00000100:00100000:1.0:1787359841.880777:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.880788:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8000 going to sleep for 11 seconds 00010000:00010000:0.0:1787359841.880914:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359841.880920:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.880929:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165ba00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787359841.880932:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.880941:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359841.880949:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359841.880956:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787359841.880982:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.880989:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359841.881013:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.881021:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef35e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x72f6de40e4ef35ef expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.881034:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359841.881036:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359841.881043:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359841.881051:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359841.881062:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527793792:0@lo:103: 00000100:00100000:0.0:1787359841.881090:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359841.881124:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793664 00000100:00100000:0.0:1787359841.881128:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793664 00000100:00100000:0.0:1787359841.881150:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787359841.881157:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527793664:12345-0@lo:101: 00010000:00010000:0.0:1787359841.881164:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359841.881174:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef35f6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.881190:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.881199:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.881207:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40800, rc 0) 00000100:00100000:0.0:1787359841.881236:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527793664:12345-0@lo:101: Request processed in 79us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.881241:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787359841.881273:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793792 00000100:00100000:0.0:1787359841.881277:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793792 00000100:00100000:0.0:1787359841.881305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359841.881311:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3319:x1874182527793792:12345-0@lo:103: 00010000:00010000:0.0:1787359841.881320:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359841.881331:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676600/0x72f6de40e4ef35ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef35e8 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.881352:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359841.881382:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3319:x1874182527793792:12345-0@lo:103: Request processed in 70us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.881388:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359841.881416:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527793792:0@lo:103: 00000100:00100000:1.0:1787359841.881494:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793664:0@lo:101: 00010000:00010000:1.0:1787359841.881505:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.881515:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.881583:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793920:0@lo:501: 00000100:00100000:1.0:1787359841.881608:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.881627:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.881800:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527793920 00000100:00100000:0.0:1787359841.881804:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527793920 00000100:00100000:0.0:1787359841.881823:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787359841.881829:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527793920:12345-0@lo:501: 00000100:00100000:0.0:1787359841.882022:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527793920:12345-0@lo:501: Request processed in 192us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.882029:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787359841.882149:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527793920:0@lo:501: 00000100:00100000:1.0:1787359841.882177:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794048:0@lo:503: 00000100:00100000:1.0:1787359841.882213:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.882246:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787359841.882301:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794048 00000100:00100000:2.0:1787359841.882306:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794048 00000100:00100000:2.0:1787359841.882327:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787359841.882333:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794048:12345-0@lo:503: 00000100:00100000:2.0:1787359841.882495:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794048:12345-0@lo:503: Request processed in 160us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.882501:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787359841.882581:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794048:0@lo:503: 00000040:00080000:1.0:1787359841.882872:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787359841.882930:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794176:0@lo:502: 00000100:00100000:1.0:1787359841.882966:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.882994:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787359841.883166:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794176 00000100:00100000:2.0:1787359841.883171:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794176 00000100:00100000:2.0:1787359841.883191:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787359841.883197:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794176:12345-0@lo:502: 00000100:00100000:2.0:1787359841.883328:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794176:12345-0@lo:502: Request processed in 130us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.883335:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787359841.883562:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794176:0@lo:502: 00000040:00080000:1.0:1787359841.883931:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787359841.883993:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787359841.884028:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787359841.884075:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787359841.884111:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787359841.884143:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787359841.884173:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794304:0@lo:502: 00000100:00100000:1.0:1787359841.884221:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.884312:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.884422:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794304 00000100:00100000:3.0:1787359841.884428:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794304 00000100:00100000:2.0:1787359841.884614:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787359841.884624:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794304:12345-0@lo:502: 00000100:00100000:2.0:1787359841.885293:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794304:12345-0@lo:502: Request processed in 668us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.885302:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787359841.885392:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794304:0@lo:502: 00000040:00080000:1.0:1787359841.885530:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787359841.885543:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787359841.886397:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787359841.886406:0:7640:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787359841.886413:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359841.886415:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787359841.886421:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787359841.886497:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff983d39bf3370) 00000020:00000080:2.0:1787359841.886523:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787359841.886529:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787359841.886608:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d11588000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787359841.886616:0:7640:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787359841.886623:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72f6de40e4ef360b 00010000:00010000:2.0:1787359841.891141:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787359841.892041:0:7640:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787359841.894773:0:7640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787359841.895145:0:7640:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787359841.899201:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787359841.900573:0:7640:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787359841.902047:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787359841.902061:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359841.902068:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359841.902070:0:7640:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787359841.902073:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359841.902078:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359841.902079:0:7640:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787359841.902081:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787359841.902083:0:7640:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787359841.902137:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359841.902140:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359841.902157:0:7640:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787359841.902162:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787359841.903592:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787359841.903627:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787359841.905726:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.905744:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359841.905752:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d11588000 from 1 10000000:01000000:1.0:1787359841.905764:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359841.905803:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.905810:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.905820:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.905854:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794432:0@lo:101: 00000100:00100000:1.0:1787359841.905924:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.907625:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359841.907913:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794432 00000100:00100000:2.0:1787359841.907923:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794432 00000100:00100000:2.0:1787359841.908024:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787359841.908036:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+12:7632:x1874182527794432:12345-0@lo:101: 00010000:00010000:2.0:1787359841.908057:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359841.908078:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3612 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.908108:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.908120:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.908129:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01677000, rc 0) 00000100:00100000:2.0:1787359841.908205:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794432:12345-0@lo:101: Request processed in 170us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.908212:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787359841.908293:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794432:0@lo:101: 00010000:00010000:1.0:1787359841.908314:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.908323:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.908526:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794560:0@lo:501: 00000100:00100000:1.0:1787359841.908561:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.908889:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.909055:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794560 00000100:00100000:0.0:1787359841.909060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794560 00000100:00100000:0.0:1787359841.909089:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787359841.909097:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794560:12345-0@lo:501: 00000100:00100000:0.0:1787359841.909351:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794560:12345-0@lo:501: Request processed in 254us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.909358:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787359841.909474:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794560:0@lo:501: 00000100:00100000:1.0:1787359841.909507:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794688:0@lo:503: 00000100:00100000:1.0:1787359841.909546:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.909577:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.909728:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794688 00000100:00100000:0.0:1787359841.909733:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794688 00000100:00100000:0.0:1787359841.909752:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787359841.909758:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794688:12345-0@lo:503: 00000100:00100000:0.0:1787359841.910089:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794688:12345-0@lo:503: Request processed in 329us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.910105:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787359841.910261:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794688:0@lo:503: 00000040:00080000:1.0:1787359841.910562:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787359841.910624:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794816:0@lo:502: 00000100:00100000:1.0:1787359841.910662:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.910703:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.910823:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794816 00000100:00100000:0.0:1787359841.910827:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794816 00000100:00100000:0.0:1787359841.910860:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787359841.910867:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794816:12345-0@lo:502: 00000100:00100000:0.0:1787359841.911027:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794816:12345-0@lo:502: Request processed in 158us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.911034:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787359841.911162:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794816:0@lo:502: 00000040:00080000:1.0:1787359841.911400:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787359841.911526:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787359841.911553:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794944:0@lo:502: 00000100:00100000:1.0:1787359841.911593:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.911626:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.911708:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527794944 00000100:00100000:0.0:1787359841.911713:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527794944 00000100:00100000:0.0:1787359841.911735:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787359841.911741:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794944:12345-0@lo:502: 00000100:00100000:0.0:1787359841.911878:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527794944:12345-0@lo:502: Request processed in 135us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.911885:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787359841.912026:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527794944:0@lo:502: 00000040:00080000:1.0:1787359841.912107:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787359841.912117:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787359841.913182:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359841.913193:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359841.913196:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787359841.913203:0:7644:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d11588000 00000020:00000080:0.0:1787359841.913206:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787359841.913227:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359841.913230:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359841.913232:0:7644:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787359841.913234:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787359841.913282:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787359841.913308:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359841.913324:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.913345:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359841.913379:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787359841.913382:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff983d11588000 10000000:01000000:0.0:1787359841.913385:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff983d11588000 10000000:01000000:0.0:1787359841.913389:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787359841.913394:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d11588000 from 1 10000000:01000000:0.0:1787359841.913397:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359841.913428:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.913436:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.914011:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359841.914033:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795072:0@lo:101: 00000100:00100000:0.0:1787359841.914092:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359841.914705:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.915110:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795072 00000100:00100000:3.0:1787359841.915119:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795072 00000100:00100000:1.0:1787359841.917314:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787359841.917332:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527795072:12345-0@lo:101: 00010000:00010000:1.0:1787359841.917349:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359841.917366:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3620 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.917394:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.917405:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.917415:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a600, rc 0) 00000100:00100000:1.0:1787359841.917607:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795072:12345-0@lo:101: Request processed in 280us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.917624:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787359841.918084:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795072:0@lo:101: 00010000:00010000:0.0:1787359841.918104:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.918115:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.918330:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795200:0@lo:501: 00000100:00100000:1.0:1787359841.918373:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.918457:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.918549:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795200 00000100:00100000:0.0:1787359841.918555:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795200 00000100:00100000:0.0:1787359841.918633:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787359841.918642:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795200:12345-0@lo:501: 00000100:00100000:0.0:1787359841.919042:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795200:12345-0@lo:501: Request processed in 399us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.919050:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787359841.919136:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795200:0@lo:501: 00000100:00100000:1.0:1787359841.919168:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795328:0@lo:503: 00000100:00100000:1.0:1787359841.919206:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.919358:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.919418:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795328 00000100:00100000:3.0:1787359841.919424:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795328 00000100:00100000:3.0:1787359841.919458:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787359841.919465:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795328:12345-0@lo:503: 00000100:00100000:3.0:1787359841.919625:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795328:12345-0@lo:503: Request processed in 159us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.919638:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787359841.919832:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795328:0@lo:503: 00000040:00080000:1.0:1787359841.920139:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787359841.920197:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795456:0@lo:502: 00000100:00100000:1.0:1787359841.920234:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.920252:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.920426:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795456 00000100:00100000:3.0:1787359841.920432:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795456 00000100:00100000:3.0:1787359841.920520:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787359841.920527:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795456:12345-0@lo:502: 00000100:00100000:3.0:1787359841.920729:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795456:12345-0@lo:502: Request processed in 202us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.920737:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787359841.920823:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795456:0@lo:502: 00000040:00080000:1.0:1787359841.921223:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787359841.921275:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787359841.921310:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787359841.921355:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787359841.921387:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787359841.921432:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787359841.921697:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787359841.921736:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787359841.921784:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787359841.921819:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787359841.921868:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787359841.921927:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787359841.921985:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787359841.922041:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787359841.922093:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787359841.922131:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787359841.922163:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787359841.922208:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787359841.922245:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787359841.922279:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787359841.922341:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787359841.922382:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787359841.922415:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787359841.922490:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787359841.922530:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787359841.922583:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787359841.922635:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787359841.922671:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787359841.922733:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787359841.922797:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787359841.922832:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787359841.922866:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787359841.922898:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787359841.922944:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787359841.922991:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787359841.923041:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787359841.923077:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787359841.923120:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795584:0@lo:502: 00000100:00100000:1.0:1787359841.923188:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.923236:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.923484:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795584 00000100:00100000:3.0:1787359841.923492:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795584 00000100:00100000:3.0:1787359841.923532:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787359841.923541:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795584:12345-0@lo:502: 00000100:00100000:3.0:1787359841.923790:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527795584:12345-0@lo:502: Request processed in 249us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.923798:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787359841.924151:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527795584:0@lo:502: 00000040:00080000:1.0:1787359841.924232:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787359841.924245:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787359841.925383:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787359841.925398:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff983d0860b370) 00000020:00000080:3.0:1787359841.925424:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787359841.925575:0:7645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d11588000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787359841.925579:0:7645:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d11588000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787359841.925582:0:7645:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d11588000 3 00010000:00080000:3.0:1787359841.925609:0:7645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d27d85800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.114@tcp at head 00010000:00010000:3.0:1787359841.928418:0:7645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787359841.928804:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787359841.928856:0:7645:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787359841.928871:0:7645:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72f6de40e4ef3635 00000100:00080000:3.0:1787359841.928882:0:7645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787359841.928898:0:7645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff983d27d85800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:3.0:1787359841.928935:0:7645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d0643d880 x1874182527795712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787359841.929038:0:7645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787359841.929211:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527795712:0@lo:38: 00000100:00100000:1.0:1787359841.929292:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359841.929484:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359841.929495:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527796096:0@lo:400: 00000100:00100000:2.0:1787359841.929523:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359841.929560:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796096 00000100:00100000:2.0:1787359841.929566:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796096 00000100:00100000:2.0:1787359841.929617:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359841.929626:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527796096:12345-0@lo:400: 00000100:00100000:2.0:1787359841.929671:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527796096:12345-0@lo:400: Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359841.929707:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787359841.929727:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359841.929754:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1e176d80 x1874182527796096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359841.929767:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527796096:0@lo:400: 00000100:00100000:1.0:1787359841.929949:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527795840:0@lo:400: 00000100:00100000:1.0:1787359841.929996:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.930022:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359841.930027:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527795968:0@lo:400: 00000100:00100000:1.0:1787359841.930050:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359841.930078:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795712 00000100:00100000:1.0:1787359841.930082:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795712 00000100:00100000:1.0:1787359841.930098:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795840 00000100:00100000:1.0:1787359841.930100:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795840 00000100:00100000:1.0:1787359841.930116:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527795968 00000100:00100000:1.0:1787359841.930118:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527795968 00000100:00100000:1.0:1787359841.930136:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787359841.930142:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527795840:12345-0@lo:400: 00000100:00100000:1.0:1787359841.930177:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527795840:12345-0@lo:400: Request processed in 35us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.930182:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787359841.930198:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787359841.930204:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527795968:12345-0@lo:400: 00000100:00100000:1.0:1787359841.930228:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527795968:12345-0@lo:400: Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.930234:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787359841.930246:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787359841.930250:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874182527795712:12345-0@lo:38: 00010000:00080000:1.0:1787359841.930269:0:5861:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:1.0:1787359841.930300:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72f6de40e4ef363c 00000004:00100000:1.0:1787359841.930315:0:5861:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787359841.930354:0:5861:0:(import.c:65:import_set_state_nolock()) ffff983d27fbf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359841.930393:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874182527795712:12345-0@lo:38: Request processed in 141us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.930399:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787359841.930425:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1e174e00 x1874182527795968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359841.930435:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527795968:0@lo:400: 00010000:00080000:1.0:1787359841.930459:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1e175180 x1874182527795840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359841.930467:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527795840:0@lo:400: 00010000:00080000:1.0:1787359841.930492:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643d880 x1874182527795712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787359851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359841.930500:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787359841.930506:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787359841.930513:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787359841.930518:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787359841.930519:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d27d85800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787359841.930526:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527795712:0@lo:38: 00000100:00080000:2.0:1787359841.930737:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787359841.931330:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1787359841.931627:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643dc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1874182527796224:0@lo:901: 00000100:00100000:3.0:1787359841.931668:0:7646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359841.931722:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f7f9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359841.932980:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796224 00000100:00100000:1.0:1787359841.932991:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796224 00000100:00100000:1.0:1787359841.933053:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787359841.933063:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1874182527796224:12345-0@lo:901: 00000100:00080000:3.0:1787359841.933552:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359841.934088:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1874182527796224:12345-0@lo:901: Request processed in 1024us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.934106:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787359841.934205:0:7646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d0643dc00 x1874182527796224/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787359857 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359841.934220:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643dc00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1874182527796224:0@lo:901: 00000020:01000000:2.0:1787359841.935821:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787359841.935938:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359841.937319:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359841.937336:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787359841.937408:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787359841.937410:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787359841.937412:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359841.937413:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359841.937414:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359841.937416:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359841.937418:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359841.937419:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359841.937421:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359841.937422:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359841.937424:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787359841.937429:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787359841.937431:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787359841.937432:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787359841.937433:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359841.937446:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359841.937447:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359841.937448:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359841.937450:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359841.937457:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359841.937458:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359841.937458:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359841.937459:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787359841.937488:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787359841.937507:0:7632:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527796352:0@lo:253: 00000100:00100000:2.0:1787359841.937573:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359841.937624:0:7632:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359841.938127:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796352 00000100:00100000:0.0:1787359841.938136:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796352 00000100:00100000:0.0:1787359841.938212:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787359841.938222:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:7632:x1874182527796352:12345-0@lo:253: 20000000:01000000:0.0:1787359841.938250:0:5855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787359841.938264:0:5855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787359841.975786:0:5855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787359841.975800:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787359841.976826:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787359841.976842:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787359841.976865:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.976884:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.976893:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.976934:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359841.976946:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 14 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359841.976994:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1874182527796480:0@lo:104: 00000100:00100000:0.0:1787359841.977058:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359841.977096:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08600 going to sleep for 11 seconds 00000100:00100000:3.0:1787359841.977285:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796480 00000100:00100000:3.0:1787359841.977293:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796480 00000100:00100000:3.0:1787359841.977340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787359841.977349:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5877:x1874182527796480:12345-0@lo:104: 00010000:00010000:3.0:1787359841.977360:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.977426:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787359841.977433:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:5877:x1874182527796480:12345-0@lo:104: Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359841.977552:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787359841.977580:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787359841.977586:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.977604:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01485000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359841.977608:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.977617:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359841.977624:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359841.977630:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359841.977657:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.977664:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359841.977703:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.977711:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01485000/0x72f6de40e4ef358d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3594 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359841.977729:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359841.977731:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359841.977733:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359841.977746:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359841.977757:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527796608:0@lo:103: 00000100:00100000:3.0:1787359841.977790:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359841.977845:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1874182527796480:0@lo:104: 00010000:00010000:3.0:1787359841.977870:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.978556:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796608 00000100:00100000:1.0:1787359841.978564:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796608 00010000:00010000:1.0:1787359841.978589:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 15 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359841.978623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359841.978631:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:3319:x1874182527796608:12345-0@lo:103: 00010000:00010000:1.0:1787359841.978642:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359841.978648:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 15 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978658:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 15 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978672:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01484200/0x72f6de40e4ef3594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef358d expref: 15 pid: 5856 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978707:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978716:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787359841.978730:0:5846:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006568801s 00010000:00010000:1.0:1787359841.978734:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978742:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978761:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978768:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978773:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359841.978778:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978785:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978800:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.978811:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359841.978935:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3319:x1874182527796608:12345-0@lo:103: Request processed in 305us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359841.978943:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359841.979093:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527796608:0@lo:103: 00010000:00010000:1.0:1787359841.979113:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.979121:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359841.979128:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef3643 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359841.991661:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:7632:x1874182527796352:12345-0@lo:253: Request processed in 53430us (54078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359841.991720:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787359841.992204:0:7632:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6055641b-d743-4e3c-a711-70d92fdecc0d:7632:1874182527796352:0@lo:253: 10000000:01000000:2.0:1787359841.992221:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787359841.992224:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787359841.992226:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787359841.992227:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787359841.992229:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787359841.992230:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787359841.992231:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787359841.992233:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787359841.992234:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787359841.992236:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787359841.992237:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787359841.992239:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787359841.992259:0:7632:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787359841.998220:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359841.998389:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359841.998700:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359842.000130:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787359842.000798:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787359842.001235:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787359842.002804:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787359842.217733:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359842.217761:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527796736:0@lo:13: 00000100:00100000:0.0:1787359842.217846:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359842.217920:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796736 00000100:00100000:0.0:1787359842.217927:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796736 00000100:00100000:0.0:1787359842.218598:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359842.218610:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527796736:12345-0@lo:13: 00002000:00000024:0.0:1787359842.218645:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359842.218726:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527796736:12345-0@lo:13: Request processed in 118us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359842.218733:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787359842.218929:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1dc0f480 x1874182527796736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359842.219031:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527796736:0@lo:13: 00002000:00080000:0.0:1787359842.253114:0:7632:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787359842.253122:0:7632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787359842.253162:0:7632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787359842.253222:0:7632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787359842.253239:0:7632:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787359842.253267:0:7632:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787359842.347540:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359843.367023:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359844.391990:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359845.417052:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359846.445948:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359847.335178:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527796864:0@lo:400: 00000100:00100000:0.0:1787359847.335252:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359847.335317:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527797376:0@lo:400: 00000100:00100000:0.0:1787359847.335351:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359847.335378:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359847.335384:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527797248:0@lo:400: 00000100:00100000:0.0:1787359847.335410:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359847.335440:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527796992:0@lo:400: 00000100:00100000:0.0:1787359847.335485:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359847.335505:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359847.335510:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527797120:0@lo:400: 00000100:00100000:0.0:1787359847.335531:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359847.335563:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797376 00000100:00100000:0.0:1787359847.335570:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797376 00000100:00100000:0.0:1787359847.335617:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796992 00000100:00100000:0.0:1787359847.335620:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796992 00000100:00100000:0.0:1787359847.335633:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797120 00000100:00100000:0.0:1787359847.335635:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797120 00000100:00100000:0.0:1787359847.335652:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359847.335660:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527797376:12345-0@lo:400: 00000100:00100000:0.0:1787359847.335729:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527797376:12345-0@lo:400: Request processed in 69us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359847.335736:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359847.335754:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359847.335760:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527796992:12345-0@lo:400: 00000100:00100000:0.0:1787359847.335792:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527796992:12345-0@lo:400: Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359847.335799:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787359847.335810:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359847.335817:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527797120:12345-0@lo:400: 00000100:00100000:0.0:1787359847.335852:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527797120:12345-0@lo:400: Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359847.335858:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359847.335889:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797248 00000100:00100000:0.0:1787359847.335892:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797248 00000100:00100000:0.0:1787359847.335920:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787359847.335927:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527797248:12345-0@lo:400: 00000100:00100000:0.0:1787359847.335958:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527797248:12345-0@lo:400: Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359847.335964:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787359847.335983:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787359847.335999:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787359847.336024:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc0d500 x1874182527797120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359847.336038:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527797120:0@lo:400: 00010000:00080000:0.0:1787359847.336049:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc0f480 x1874182527796992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359847.336057:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527796992:0@lo:400: 00010000:00080000:0.0:1787359847.336084:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc0df80 x1874182527797248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359847.336093:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527797248:0@lo:400: 00010000:00080000:0.0:1787359847.336103:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc0e300 x1874182527797376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359847.336111:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527797376:0@lo:400: 00000100:00100000:2.0:1787359847.336449:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527796864 00000100:00100000:2.0:1787359847.336454:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527796864 00000100:00100000:2.0:1787359847.336492:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787359847.336499:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3318:x1874182527796864:12345-0@lo:400: 00000100:00100000:2.0:1787359847.336544:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3318:x1874182527796864:12345-0@lo:400: Request processed in 45us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359847.336550:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787359847.336597:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527796864:0@lo:400: 00000100:00100000:0.0:1787359847.338221:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359847.338252:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527797504:0@lo:13: 00000100:00100000:0.0:1787359847.338304:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359847.338344:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797504 00000100:00100000:0.0:1787359847.338350:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797504 00000100:00100000:0.0:1787359847.338385:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787359847.338394:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527797504:12345-0@lo:13: 00002000:00000024:0.0:1787359847.338424:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359847.338466:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527797504:12345-0@lo:13: Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359847.338473:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787359847.338506:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc0e300 x1874182527797504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359847.338523:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527797504:0@lo:13: 00010000:00010000:3.0:1787359847.463255:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359848.487383:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359849.169202:0:7989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787359849.514195:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787359849.896744:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787359849.896752:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d200eb000 from 30 10000000:01000000:3.0:1787359849.896758:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787359849.896806:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.896819:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.896831:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359849.896866:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527797632:0@lo:101: 00000100:00100000:3.0:1787359849.897038:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359849.897117:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.897127:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797632 00000100:00100000:0.0:1787359849.897136:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797632 00000100:00100000:0.0:1787359849.897185:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787359849.897193:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527797632:12345-0@lo:101: 00010000:00010000:0.0:1787359849.897204:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359849.897217:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef364a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.897243:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.897255:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.897276:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41600, rc 0) 00000100:00100000:0.0:1787359849.897317:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527797632:12345-0@lo:101: Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.897322:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787359849.897357:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527797632:0@lo:101: 00010000:00010000:3.0:1787359849.897492:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.897504:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359849.897569:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527797760:0@lo:501: 00000100:00100000:3.0:1787359849.897604:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359849.897634:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.897724:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797760 00000100:00100000:0.0:1787359849.897729:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797760 00000100:00100000:0.0:1787359849.897758:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787359849.897766:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527797760:12345-0@lo:501: 00000100:00100000:0.0:1787359849.898301:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527797760:12345-0@lo:501: Request processed in 535us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.898308:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787359849.898337:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527797760:0@lo:501: 00000100:00100000:3.0:1787359849.898529:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527797888:0@lo:503: 00000100:00100000:3.0:1787359849.898571:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359849.898611:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.899546:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527797888 00000100:00100000:0.0:1787359849.899554:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527797888 00000100:00100000:0.0:1787359849.899602:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787359849.899611:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527797888:12345-0@lo:503: 00000100:00100000:0.0:1787359849.903600:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527797888:12345-0@lo:503: Request processed in 3980us (5018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.903616:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787359849.903638:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527797888:0@lo:503: 00000100:00100000:2.0:1787359849.904274:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8015:1874182527798016:0@lo:502: 00000100:00100000:2.0:1787359849.904333:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.904377:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.905330:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798016 00000100:00100000:0.0:1787359849.905340:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798016 00000100:00100000:0.0:1787359849.905398:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787359849.905409:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8015:x1874182527798016:12345-0@lo:502: 00000100:00100000:0.0:1787359849.905775:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8015:x1874182527798016:12345-0@lo:502: Request processed in 367us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.905784:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787359849.905906:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8015:1874182527798016:0@lo:502: 00000100:00100000:2.0:1787359849.905971:0:8015:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8015:1874182527798144:0@lo:502: 00000100:00100000:2.0:1787359849.907345:0:8015:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.907403:0:8015:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.910790:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798144 00000100:00100000:0.0:1787359849.910805:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798144 00000100:00100000:0.0:1787359849.910886:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787359849.910898:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8015:x1874182527798144:12345-0@lo:502: 00000100:00100000:0.0:1787359849.912355:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8015:x1874182527798144:12345-0@lo:502: Request processed in 1453us (6334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.912368:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787359849.913795:0:8015:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8015:1874182527798144:0@lo:502: 00000040:00080000:2.0:1787359849.913851:0:8015:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787359849.913983:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787359849.914009:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787359849.914023:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.914035:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359849.914045:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787359849.914048:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787359849.914051:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787359849.914104:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.914119:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.914130:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359849.914150:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798272:0@lo:101: 00000100:00100000:3.0:1787359849.914408:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359849.914466:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.914636:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798272 00000100:00100000:0.0:1787359849.914643:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798272 00000100:00100000:0.0:1787359849.914712:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787359849.914721:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527798272:12345-0@lo:101: 00010000:00010000:0.0:1787359849.914734:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359849.914747:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3658 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.914771:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.914782:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.914791:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787359849.914858:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527798272:12345-0@lo:101: Request processed in 137us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.914870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787359849.914880:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798272:0@lo:101: 00010000:00010000:2.0:1787359849.914898:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.914908:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359849.914962:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798400:0@lo:501: 00000100:00100000:2.0:1787359849.914996:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.915041:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054180 going to sleep for 11 seconds 00000100:00100000:3.0:1787359849.915052:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798400 00000100:00100000:3.0:1787359849.915058:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798400 00000100:00100000:3.0:1787359849.915091:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787359849.915098:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527798400:12345-0@lo:501: 00000100:00100000:3.0:1787359849.915986:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527798400:12345-0@lo:501: Request processed in 886us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359849.915996:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787359849.916553:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798400:0@lo:501: 00000100:00100000:2.0:1787359849.916597:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798528:0@lo:503: 00000100:00100000:2.0:1787359849.916636:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.916719:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054180 going to sleep for 11 seconds 00000100:00100000:1.0:1787359849.916967:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798528 00000100:00100000:1.0:1787359849.916974:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798528 00000100:00100000:1.0:1787359849.917023:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787359849.917032:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527798528:12345-0@lo:503: 00000100:00100000:1.0:1787359849.917378:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527798528:12345-0@lo:503: Request processed in 347us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359849.917386:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787359849.917575:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798528:0@lo:503: 00000100:00100000:0.0:1787359849.919785:0:8017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8017:1874182527798656:0@lo:502: 00000100:00100000:0.0:1787359849.919869:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.919919:0:8017:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dac480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.921768:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798656 00000100:00100000:2.0:1787359849.921784:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798656 00000100:00100000:2.0:1787359849.921897:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787359849.921910:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8017:x1874182527798656:12345-0@lo:502: 00000100:00100000:2.0:1787359849.922229:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8017:x1874182527798656:12345-0@lo:502: Request processed in 321us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.922237:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787359849.922341:0:8017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8017:1874182527798656:0@lo:502: 00000020:01000000:0.0:1787359849.922375:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359849.922385:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359849.922387:0:8017:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787359849.922395:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787359849.922397:0:8017:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787359849.922424:0:8017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8017:1874182527798784:0@lo:502: 00000100:00100000:0.0:1787359849.922478:0:8017:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.927005:0:8017:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dac480 going to sleep for 11 seconds 00000100:00100000:1.0:1787359849.927234:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798784 00000100:00100000:1.0:1787359849.927243:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798784 00000100:00100000:1.0:1787359849.927293:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787359849.927304:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8017:x1874182527798784:12345-0@lo:502: 00000100:00100000:1.0:1787359849.934595:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8017:x1874182527798784:12345-0@lo:502: Request processed in 7282us (12106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359849.934609:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787359849.941148:0:8017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8017:1874182527798784:0@lo:502: 00000020:01000000:3.0:1787359849.941575:0:8017:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359849.941588:0:8017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359849.941590:0:8017:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787359849.941595:0:8017:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787359849.941718:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787359849.941742:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787359849.941753:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.941764:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359849.941775:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787359849.941778:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d0dccf000 from 30 10000000:01000000:0.0:1787359849.941782:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359849.941818:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.941826:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.941844:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359849.941881:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798912:0@lo:101: 00000100:00100000:0.0:1787359849.941952:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.942616:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dac480 going to sleep for 11 seconds 00000100:00100000:3.0:1787359849.944506:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527798912 00000100:00100000:3.0:1787359849.944521:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527798912 00000100:00100000:3.0:1787359849.944598:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787359849.944608:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527798912:12345-0@lo:101: 00010000:00010000:3.0:1787359849.944625:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359849.944644:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3666 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.944715:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.944727:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359849.944736:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63400, rc 0) 00000100:00100000:3.0:1787359849.944814:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527798912:12345-0@lo:101: Request processed in 208us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359849.944821:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787359849.945025:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527798912:0@lo:101: 00010000:00010000:2.0:1787359849.945044:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.945054:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359849.945124:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799040:0@lo:501: 00000100:00100000:2.0:1787359849.945171:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.945208:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d200543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.945323:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799040 00000100:00100000:0.0:1787359849.945329:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799040 00000100:00100000:0.0:1787359849.945364:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787359849.945372:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527799040:12345-0@lo:501: 00000100:00100000:0.0:1787359849.945645:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527799040:12345-0@lo:501: Request processed in 273us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.945652:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787359849.945887:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799040:0@lo:501: 00000100:00100000:2.0:1787359849.945918:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799168:0@lo:503: 00000100:00100000:2.0:1787359849.945960:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.945992:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d200543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.946005:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799168 00000100:00100000:2.0:1787359849.946009:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799168 00000100:00100000:2.0:1787359849.946030:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787359849.946036:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527799168:12345-0@lo:503: 00000100:00100000:2.0:1787359849.946203:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527799168:12345-0@lo:503: Request processed in 166us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.946211:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787359849.946250:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799168:0@lo:503: 00000100:00100000:2.0:1787359849.946435:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8018:1874182527799296:0@lo:502: 00000100:00100000:2.0:1787359849.946488:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.946508:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799296 00000100:00100000:2.0:1787359849.946512:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799296 00000100:00100000:2.0:1787359849.946530:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787359849.946536:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8018:x1874182527799296:12345-0@lo:502: 00000100:00100000:2.0:1787359849.946711:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8018:x1874182527799296:12345-0@lo:502: Request processed in 174us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.946718:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787359849.946746:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054180 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.946759:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8018:1874182527799296:0@lo:502: 00000100:00100000:2.0:1787359849.946799:0:8018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8018:1874182527799424:0@lo:502: 00000100:00100000:2.0:1787359849.946831:0:8018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.946862:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799424 00000100:00100000:2.0:1787359849.946865:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799424 00000100:00100000:2.0:1787359849.946882:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787359849.946887:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8018:x1874182527799424:12345-0@lo:502: 00000100:00100000:2.0:1787359849.947003:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8018:x1874182527799424:12345-0@lo:502: Request processed in 115us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.947010:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787359849.947037:0:8018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054180 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.947048:0:8018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8018:1874182527799424:0@lo:502: 00000040:00080000:2.0:1787359849.947067:0:8018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787359849.947114:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787359849.947127:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359849.947136:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947156:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359849.947165:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787359849.947168:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d0dccf000 from 5 10000000:01000000:2.0:1787359849.947171:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787359849.947195:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947203:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947212:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359849.947224:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799552:0@lo:101: 00000100:00100000:2.0:1787359849.947249:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.947263:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.947274:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799552 00000100:00100000:2.0:1787359849.947277:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799552 00000100:00100000:2.0:1787359849.947293:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787359849.947298:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527799552:12345-0@lo:101: 00010000:00010000:2.0:1787359849.947306:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359849.947317:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676600/0x72f6de40e4ef367b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3674 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947336:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676600/0x72f6de40e4ef367b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3674 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947356:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676600/0x72f6de40e4ef367b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3674 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947365:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676600, rc 0) 00000100:00100000:2.0:1787359849.947396:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527799552:12345-0@lo:101: Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.947402:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787359849.947430:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799552:0@lo:101: 00010000:00010000:2.0:1787359849.947442:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947450:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359849.947490:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799680:0@lo:256: 00000100:00100000:2.0:1787359849.947520:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.947532:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.947543:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799680 00000100:00100000:2.0:1787359849.947546:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799680 00000100:00100000:2.0:1787359849.947562:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787359849.947568:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527799680:12345-0@lo:256: 20000000:01000000:2.0:1787359849.947581:0:5853:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787359849.947597:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787359849.947600:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787359849.947671:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527799680:12345-0@lo:256: Request processed in 103us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.947701:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787359849.947735:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799680:0@lo:256: 10000000:01000000:2.0:1787359849.947773:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787359849.947778:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947786:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359849.947792:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787359849.947794:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787359849.947796:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787359849.947811:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947819:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947826:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359849.947847:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799808:0@lo:101: 00000100:00100000:2.0:1787359849.947870:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.947883:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d10401d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.947894:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799808 00000100:00100000:2.0:1787359849.947897:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799808 00000100:00100000:2.0:1787359849.947913:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787359849.947918:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527799808:12345-0@lo:101: 00010000:00010000:2.0:1787359849.947925:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359849.947933:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3682 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947953:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947961:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.947968:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676400, rc 0) 00000100:00100000:2.0:1787359849.948001:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527799808:12345-0@lo:101: Request processed in 82us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.948006:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787359849.948034:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799808:0@lo:101: 00010000:00010000:2.0:1787359849.948045:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359849.948053:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359849.948093:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799936:0@lo:501: 00000100:00100000:2.0:1787359849.948115:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.948128:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.948138:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527799936 00000100:00100000:2.0:1787359849.948141:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527799936 00000100:00100000:2.0:1787359849.948157:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787359849.948163:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527799936:12345-0@lo:501: 00000100:00100000:2.0:1787359849.948382:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527799936:12345-0@lo:501: Request processed in 218us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.948389:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787359849.948423:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527799936:0@lo:501: 00000100:00100000:2.0:1787359849.948446:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527800064:0@lo:503: 00000100:00100000:2.0:1787359849.948480:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.948493:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.948504:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800064 00000100:00100000:2.0:1787359849.948507:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800064 00000100:00100000:2.0:1787359849.948523:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787359849.948528:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527800064:12345-0@lo:503: 00000100:00100000:2.0:1787359849.948817:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527800064:12345-0@lo:503: Request processed in 287us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.948825:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787359849.953781:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527800064:0@lo:503: 00000100:00100000:1.0:1787359849.963859:0:8019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8019:1874182527800192:0@lo:502: 00000100:00100000:1.0:1787359849.964766:0:8019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359849.965825:0:8019:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787359849.977909:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800192 00000100:00100000:3.0:1787359849.977923:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800192 00000100:00100000:3.0:1787359849.977977:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787359849.977987:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8019:x1874182527800192:12345-0@lo:502: 00000100:00100000:3.0:1787359849.979669:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8019:x1874182527800192:12345-0@lo:502: Request processed in 1676us (14898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359849.979703:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787359849.980254:0:8019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8019:1874182527800192:0@lo:502: 00000020:01000000:1.0:1787359849.980295:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787359849.980303:0:8019:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787359849.980311:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359849.980313:0:8019:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787359849.980319:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787359849.980323:0:8019:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.114@tcp to nid 0x20000c0a8c972 (192.168.201.114@tcp) 00000020:01000000:1.0:1787359849.980419:0:8019:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787359849.980428:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787359849.980443:0:8019:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff983d3f654d28) 00000020:00000080:1.0:1787359849.980466:0:8019:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787359849.980473:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787359849.980559:0:8019:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787359849.980565:0:8019:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787359849.980571:0:8019:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef3697 00010000:00080000:1.0:1787359849.980599:0:8019:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d3f388000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.114@tcp at head 00010000:00010000:1.0:1787359849.980881:0:8019:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787359849.981880:0:8019:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787359849.981896:0:8019:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787359849.982564:0:8019:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787359849.982784:0:8019:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787359849.982843:0:8019:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787359849.982897:0:8019:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787359849.983334:0:8020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787359849.983339:0:8020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787359849.984007:0:8019:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787359849.984017:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787359849.984046:0:8019:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787359849.984067:0:8019:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef369e 00000100:00080000:1.0:1787359849.984076:0:8019:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787359849.984081:0:8019:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff983d3f388000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787359849.984112:0:8019:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3a038000 x1874182527800320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787359849.984139:0:8019:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787359849.984299:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359849.984303:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359849.984305:0:8019:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787359849.984308:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359849.984312:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359849.984313:0:8019:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787359849.984316:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787359849.984323:0:8019:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787359849.984362:0:8019:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a039880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8019:1874182527800448:0@lo:502: 00000100:00100000:1.0:1787359849.984445:0:8019:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359849.984480:0:8019:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d200543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359849.984596:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527800320:0@lo:8: 00000100:00100000:2.0:1787359849.984641:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359849.984716:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800448 00000100:00100000:2.0:1787359849.984722:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800448 00000100:00100000:2.0:1787359849.984767:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787359849.984776:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8019:x1874182527800448:12345-0@lo:502: 00000100:00100000:2.0:1787359849.985022:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8019:x1874182527800448:12345-0@lo:502: Request processed in 246us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359849.985031:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787359849.986343:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800320 00000100:00100000:1.0:1787359849.986365:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800320 00000100:00100000:1.0:1787359849.986398:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359849.986406:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1874182527800320:12345-0@lo:8: 00010000:00080000:1.0:1787359849.986433:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1787359849.986461:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef36a5 00002000:00100000:1.0:1787359849.986477:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff983d407f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787359849.986480:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787359849.986484:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787359849.986600:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787359849.986770:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787359849.986800:0:6698:0:(import.c:65:import_set_state_nolock()) ffff983d407fc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359849.986885:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874182527800320:12345-0@lo:8: Request processed in 478us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359849.986892:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359849.986943:0:8019:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a039880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8019:1874182527800448:0@lo:502: 00000020:01000000:1.0:1787359849.986978:0:8019:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359849.986983:0:8019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359849.986986:0:8019:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787359849.986990:0:8019:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787359849.987596:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787359849.987628:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787359849.987639:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.987651:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359849.987661:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787359849.987664:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff983d111f3370 from 1 10000000:01000000:0.0:1787359849.987666:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787359849.987717:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.987726:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.987749:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359849.987766:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527800576:0@lo:101: 00000100:00100000:0.0:1787359849.987810:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.987852:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.987868:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800576 00000100:00100000:0.0:1787359849.987872:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800576 00000100:00100000:0.0:1787359849.987903:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787359849.987910:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527800576:12345-0@lo:101: 00010000:00010000:0.0:1787359849.987930:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359849.987941:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef36ac expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.987960:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.987970:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.987978:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40400, rc 0) 00000100:00100000:0.0:1787359849.988005:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527800576:12345-0@lo:101: Request processed in 95us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.988011:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787359849.988040:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527800576:0@lo:101: 00010000:00010000:0.0:1787359849.988051:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.988070:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359849.988113:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527800704:0@lo:501: 00000100:00100000:0.0:1787359849.988135:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.988150:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dac0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359849.988161:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800704 00000100:00100000:0.0:1787359849.988176:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800704 00000100:00100000:0.0:1787359849.988199:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787359849.988204:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527800704:12345-0@lo:501: 00000100:00100000:0.0:1787359849.988390:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527800704:12345-0@lo:501: Request processed in 185us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787359849.988398:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787359849.988422:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527800704:0@lo:501: 10000000:01000000:0.0:1787359849.988437:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787359849.988442:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359849.988450:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359849.989950:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359849.990034:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359849.990051:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527801216:0@lo:400: 00000100:00100000:0.0:1787359849.990101:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.990134:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527800960:0@lo:400: 00000100:00100000:0.0:1787359849.990186:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.990206:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359849.990212:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527801088:0@lo:400: 00000100:00100000:0.0:1787359849.990238:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.990270:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801216 00000100:00100000:0.0:1787359849.990276:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801216 00000100:00100000:0.0:1787359849.990320:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800960 00000100:00100000:0.0:1787359849.990323:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800960 00000100:00100000:0.0:1787359849.990339:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359849.990359:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527801216:12345-0@lo:400: 00000100:00100000:0.0:1787359849.990403:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527801216:12345-0@lo:400: Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.990409:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787359849.990423:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787359849.990429:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527800960:12345-0@lo:400: 00000100:00100000:0.0:1787359849.990451:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527800960:12345-0@lo:400: Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.990457:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787359849.990477:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801088 00000100:00100000:0.0:1787359849.990480:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801088 00000100:00100000:0.0:1787359849.990505:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787359849.990512:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527801088:12345-0@lo:400: 00000100:00100000:0.0:1787359849.990541:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527801088:12345-0@lo:400: Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.990546:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787359849.990559:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787359849.990564:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787359849.990586:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d0643e300 x1874182527801216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359849.990606:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527801216:0@lo:400: 00010000:00080000:0.0:1787359849.990629:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d0643e680 x1874182527801088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359849.990637:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527801088:0@lo:400: 00010000:00080000:0.0:1787359849.990645:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d0643d500 x1874182527800960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359849.990652:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527800960:0@lo:400: 00010000:00080000:2.0:1787359849.990956:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a038000 x1874182527800320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787359859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359849.990966:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787359849.990974:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787359849.990981:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787359849.990986:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787359849.990995:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d3f388000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787359849.991005:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787359849.991010:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527800320:0@lo:8: 00000100:00100000:1.0:1787359849.991322:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527800832:0@lo:400: 00000100:00100000:1.0:1787359849.991421:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359849.995291:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527800832 00000100:00100000:0.0:1787359849.995309:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527800832 00000100:00100000:0.0:1787359849.997159:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1787359849.997306:0:8020:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787359849.997428:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527800832:12345-0@lo:400: 00000100:00100000:0.0:1787359849.997526:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527800832:12345-0@lo:400: Request processed in 102us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359849.997534:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787359849.997584:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d0643c700 x1874182527800832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359849.997600:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527800832:0@lo:400: 00000004:00080000:3.0:1787359849.997622:0:8020:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 224325944196ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787359850.017478:0:8021:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787359850.017511:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801472:0@lo:7: 00000100:00100000:2.0:1787359850.017581:0:8021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359850.017615:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787359850.017996:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527801344:0@lo:13: 00000100:00100000:0.0:1787359850.018037:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359850.018121:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801472 00000100:00100000:0.0:1787359850.018129:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801472 00000100:00100000:0.0:1787359850.018267:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359850.018278:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8021:x1874182527801472:12345-0@lo:7: 00000100:00080000:3.0:1787359850.018433:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359850.019474:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801344 00000100:00100000:2.0:1787359850.019484:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801344 00000100:00100000:2.0:1787359850.019530:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787359850.019539:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527801344:12345-0@lo:13: 00002000:00000024:2.0:1787359850.019565:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787359850.019637:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527801344:12345-0@lo:13: Request processed in 99us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359850.019645:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787359850.023810:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e174a80 x1874182527801344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359850.023926:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527801344:0@lo:13: 00002000:00080000:0.0:1787359850.028311:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787359850.028319:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787359850.028430:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8021:x1874182527801472:12345-0@lo:7: Request processed in 10149us (10844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359850.028442:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787359850.028899:0:8021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e175500 x1874182527801472/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787359866 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359850.028915:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801472:0@lo:7: 00000004:00080000:3.0:1787359850.028929:0:8021:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787359850.028978:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801600:0@lo:5: 00000100:00100000:3.0:1787359850.029018:0:8021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359850.029051:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359850.029133:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801600 00000100:00100000:0.0:1787359850.029140:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801600 00000100:00100000:0.0:1787359850.029250:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787359850.029260:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8021:x1874182527801600:12345-0@lo:5: 00002000:00080000:0.0:1787359850.029287:0:6698:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787359850.029291:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787359850.029617:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8021:x1874182527801600:12345-0@lo:5: Request processed in 358us (598us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787359850.029624:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787359850.029655:0:8021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d0643c700 x1874182527801600/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359866 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359850.029666:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801600:0@lo:5: 00000004:00080000:0.0:1787359850.030046:0:8021:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787359850.030080:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801728:0@lo:700: 00000100:00100000:0.0:1787359850.030128:0:8021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359850.030152:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dace40 going to sleep for 11 seconds 00000100:00100000:0.0:1787359850.030897:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801728 00000100:00100000:0.0:1787359850.030905:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801728 00000100:00100000:0.0:1787359850.030987:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359850.030997:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8021:x1874182527801728:12345-0@lo:700: 00000100:00100000:0.0:1787359850.031038:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1874182527801856:0@lo:700: 00000100:00100000:0.0:1787359850.031080:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359850.031110:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09dac240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359850.031157:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801856 00000100:00100000:2.0:1787359850.031161:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801856 00000100:00100000:2.0:1787359850.031297:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359850.031305:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1874182527801856:12345-0@lo:700: 00000004:00080000:3.0:1787359850.071111:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787359850.125254:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787359850.137533:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1874182527801856:12345-0@lo:700: Request processed in 106218us (106440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359850.137556:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787359850.137673:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40983800 x1874182527801856/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787359866 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359850.137731:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1874182527801856:0@lo:700: 40000000:02000000:0.0:1787359850.137744:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787359850.256043:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787359850.256063:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787359850.256278:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8021:x1874182527801728:12345-0@lo:700: Request processed in 225278us (226145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359850.256287:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787359850.256360:0:8021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc0dc00 x1874182527801728/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787359866 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359850.256369:0:8021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787359850.256383:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801728:0@lo:700: 00000004:02000040:3.0:1787359850.313572:0:8021:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787359850.323191:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801984:0@lo:5: 00000100:00100000:3.0:1787359850.323263:0:8021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359850.323374:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359850.324142:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527801984 00000100:00100000:2.0:1787359850.324151:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527801984 00000100:00100000:3.0:1787359850.326970:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787359850.326983:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8021:x1874182527801984:12345-0@lo:5: 00002000:00080000:2.0:1787359850.344292:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787359850.344314:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787359850.350821:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8021:x1874182527801984:12345-0@lo:5: Request processed in 23831us (27548us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787359850.350845:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787359850.353792:0:8021:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d0643c700 x1874182527801984/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787359866 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359850.353819:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8021:1874182527801984:0@lo:5: 00000004:00080000:3.0:1787359850.353845:0:8021:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787359850.535230:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359851.559608:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359852.455910:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527802112:0@lo:13: 00000100:00100000:0.0:1787359852.456008:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359852.456823:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802112 00000100:00100000:0.0:1787359852.456838:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802112 00000100:00100000:0.0:1787359852.456925:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787359852.456936:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527802112:12345-0@lo:13: 00002000:00000024:0.0:1787359852.456987:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359852.457075:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527802112:12345-0@lo:13: Request processed in 139us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359852.457083:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787359852.457137:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40983800 x1874182527802112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359852.457161:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527802112:0@lo:13: 00000100:00080000:3.0:1787359852.461397:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787359852.584179:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359853.612488:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359854.630926:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787359854.918854:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787359855.021545:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527802240:0@lo:400: 00000100:00100000:1.0:1787359855.021626:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359855.021756:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802240 00000100:00100000:3.0:1787359855.021764:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802240 00000100:00100000:3.0:1787359855.021816:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787359855.021826:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527802240:12345-0@lo:400: 00000100:00100000:3.0:1787359855.022791:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527802240:12345-0@lo:400: Request processed in 964us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.022800:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787359855.022909:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527802624:0@lo:400: 00000100:00100000:2.0:1787359855.022950:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359855.026396:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802624 00000100:00100000:3.0:1787359855.026412:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802624 00000100:00100000:3.0:1787359855.026491:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787359855.026502:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527802624:12345-0@lo:400: 00000100:00100000:3.0:1787359855.026621:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527802624:12345-0@lo:400: Request processed in 121us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.026629:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787359855.026742:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787359855.026790:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40981f80 x1874182527802624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359855.026806:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527802624:0@lo:400: 00000100:00100000:1.0:1787359855.027105:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527802240:0@lo:400: 00000100:00100000:1.0:1787359855.027133:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527802496:0@lo:400: 00000100:00100000:1.0:1787359855.027175:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359855.027216:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359855.027223:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527802368:0@lo:400: 00000100:00100000:1.0:1787359855.027244:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359855.027316:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802496 00000100:00100000:1.0:1787359855.027321:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802496 00000100:00100000:1.0:1787359855.027355:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802368 00000100:00100000:1.0:1787359855.027358:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802368 00000100:00100000:1.0:1787359855.027373:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787359855.027380:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527802496:12345-0@lo:400: 00000100:00100000:1.0:1787359855.027416:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527802496:12345-0@lo:400: Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.027423:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787359855.027436:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359855.027442:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527802368:12345-0@lo:400: 00000100:00100000:1.0:1787359855.027465:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527802368:12345-0@lo:400: Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.027482:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787359855.027519:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787359855.027552:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40982300 x1874182527802368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359855.027562:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527802368:0@lo:400: 00010000:00080000:1.0:1787359855.027572:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40982680 x1874182527802496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359855.027580:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527802496:0@lo:400: 00000100:00100000:0.0:1787359855.029816:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359855.029837:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527802752:0@lo:400: 00000100:00100000:0.0:1787359855.029895:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359855.029963:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527802880:0@lo:400: 00000100:00100000:0.0:1787359855.030004:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359855.030038:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802880 00000100:00100000:0.0:1787359855.030045:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802880 00000100:00100000:0.0:1787359855.030095:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787359855.030104:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527802880:12345-0@lo:400: 00000100:00100000:0.0:1787359855.030153:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527802880:12345-0@lo:400: Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359855.030159:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787359855.030198:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40982a00 x1874182527802880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359855.030208:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787359855.030225:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527802880:0@lo:400: 00000100:00100000:1.0:1787359855.030617:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527802752 00000100:00100000:1.0:1787359855.030622:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527802752 00000100:00100000:1.0:1787359855.030663:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787359855.030671:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874182527802752:12345-0@lo:400: 00000100:00100000:1.0:1787359855.030735:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874182527802752:12345-0@lo:400: Request processed in 65us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.030742:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787359855.030776:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787359855.030780:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787359855.030798:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40980700 x1874182527802752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787359871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359855.030809:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527802752:0@lo:400: 00000100:00100000:3.0:1787359855.511817:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359855.512730:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508904576 00000100:00100000:3.0:1787359855.512750:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508904576 00000100:00100000:3.0:1787359855.512795:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 112 00000100:00100000:3.0:1787359855.512804:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874182508904576:12345-192.168.201.14@tcp:250: 00010000:00080000:3.0:1787359855.512830:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 03658e77-9945-4faf-b424-380f2de8cb18@192.168.201.14@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1787359855.512860:0:5856:0:(genops.c:1385:class_connect()) connect: client 03658e77-9945-4faf-b424-380f2de8cb18, cookie 0x72f6de40e4ef36ba 00000100:00080000:3.0:1787359855.513022:0:5856:0:(import.c:65:import_set_state_nolock()) ffff983d27d85000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359855.513093:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+5:2361:x1874182508904576:12345-192.168.201.14@tcp:250: Request processed in 288us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.513115:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 112 00000100:00100000:3.0:1787359855.525242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359855.525423:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508904704 00000100:00100000:2.0:1787359855.525434:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508904704 00000100:00100000:2.0:1787359855.525486:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 113 00000100:00100000:2.0:1787359855.525496:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+5:5589:x1874182508904704:12345-192.168.201.14@tcp:101: 00010000:00010000:2.0:1787359855.525513:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359855.525532:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce38e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359855.525561:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359855.525573:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359855.525584:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676000, rc 0) 00000100:00100000:2.0:1787359855.525656:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+6:5589:x1874182508904704:12345-192.168.201.14@tcp:101: Request processed in 160us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359855.525663:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 113 00000100:00100000:1.0:1787359855.526838:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527803008:0@lo:13: 00000100:00100000:1.0:1787359855.526918:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359855.527538:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803008 00000100:00100000:0.0:1787359855.527547:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803008 00000100:00100000:0.0:1787359855.527599:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787359855.527608:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527803008:12345-0@lo:13: 00002000:00000024:0.0:1787359855.527644:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359855.527750:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527803008:12345-0@lo:13: Request processed in 132us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359855.527757:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787359855.527837:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a038000 x1874182527803008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359855.527857:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527803008:0@lo:13: 00000100:00100000:2.0:1787359855.533938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359855.533978:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508904832 00000100:00100000:2.0:1787359855.533988:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508904832 00000100:00100000:0.0:1787359855.534381:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 114 00000100:00100000:0.0:1787359855.534393:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+6:5589:x1874182508904832:12345-192.168.201.14@tcp:501: 00000100:00100000:0.0:1787359855.534832:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+6:5589:x1874182508904832:12345-192.168.201.14@tcp:501: Request processed in 439us (904us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787359855.534842:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 114 00000100:00100000:1.0:1787359855.538980:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359855.539237:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508904960 00000100:00100000:3.0:1787359855.539248:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508904960 00000100:00100000:3.0:1787359855.539302:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:3.0:1787359855.539313:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+6:5589:x1874182508904960:12345-192.168.201.14@tcp:101: 00010000:00010000:3.0:1787359855.539328:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359855.539347:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce395 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359855.539375:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359855.539387:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359855.539396:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63a00, rc 0) 00000100:00100000:3.0:1787359855.539457:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+7:5589:x1874182508904960:12345-192.168.201.14@tcp:101: Request processed in 145us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.539463:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:3.0:1787359855.543149:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359855.543518:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905088 00000100:00100000:0.0:1787359855.543528:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905088 00000100:00100000:0.0:1787359855.543581:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 116 00000100:00100000:0.0:1787359855.543589:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+7:5589:x1874182508905088:12345-192.168.201.14@tcp:501: 00000100:00100000:0.0:1787359855.544440:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+8:5589:x1874182508905088:12345-192.168.201.14@tcp:501: Request processed in 848us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359855.544448:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 116 00000100:00100000:2.0:1787359855.573806:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359855.573914:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905216 00000100:00100000:3.0:1787359855.573925:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905216 00000100:00100000:3.0:1787359855.573976:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 117 00000100:00100000:3.0:1787359855.573987:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+8:5589:x1874182508905216:12345-192.168.201.14@tcp:503: 00000100:00100000:3.0:1787359855.574375:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+8:5589:x1874182508905216:12345-192.168.201.14@tcp:503: Request processed in 389us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.574392:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 117 00000100:00100000:1.0:1787359855.582970:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359855.583145:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905344 00000100:00100000:0.0:1787359855.583156:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905344 00000100:00100000:0.0:1787359855.583216:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 118 00000100:00100000:0.0:1787359855.583229:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+8:5608:x1874182508905344:12345-192.168.201.14@tcp:502: 00000100:00100000:0.0:1787359855.583778:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+8:5608:x1874182508905344:12345-192.168.201.14@tcp:502: Request processed in 550us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359855.583786:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 118 00000100:00100000:2.0:1787359855.646637:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359855.647533:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905472 00000100:00100000:0.0:1787359855.647544:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905472 00000100:00100000:0.0:1787359855.647606:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 119 00000100:00100000:0.0:1787359855.647616:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+8:5608:x1874182508905472:12345-192.168.201.14@tcp:502: 00000100:00100000:0.0:1787359855.648003:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+8:5608:x1874182508905472:12345-192.168.201.14@tcp:502: Request processed in 387us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359855.648011:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 119 00010000:00010000:2.0:1787359855.656347:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359855.660660:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359855.660841:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905600 00000100:00100000:3.0:1787359855.660851:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905600 00000100:00100000:3.0:1787359855.660905:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 120 00000100:00100000:3.0:1787359855.660916:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+8:5589:x1874182508905600:12345-192.168.201.14@tcp:101: 00010000:00010000:3.0:1787359855.660932:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359855.660952:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62e00/0x72f6de40e4ef36cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce3bf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359855.660977:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62e00/0x72f6de40e4ef36cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3bf expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359855.660985:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62e00/0x72f6de40e4ef36cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3bf expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359855.660992:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62e00, rc 0) 00000100:00100000:3.0:1787359855.661044:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+9:5589:x1874182508905600:12345-192.168.201.14@tcp:101: Request processed in 131us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.661050:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 120 00000100:00100000:3.0:1787359855.664098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359855.664510:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905728 00000100:00100000:0.0:1787359855.664520:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905728 00000100:00100000:0.0:1787359855.664594:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 121 00000100:00100000:0.0:1787359855.664610:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+9:5589:x1874182508905728:12345-192.168.201.14@tcp:256: 20000000:01000000:0.0:1787359855.664636:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787359855.664666:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787359855.664669:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787359855.664671:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787359855.664673:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787359855.666135:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+9:5589:x1874182508905728:12345-192.168.201.14@tcp:256: Request processed in 1519us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.666149:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 121 00000100:00100000:2.0:1787359855.675878:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359855.676838:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905856 00000100:00100000:1.0:1787359855.676849:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905856 00000100:00100000:1.0:1787359855.676927:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 122 00000100:00100000:1.0:1787359855.676937:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:5589:x1874182508905856:12345-192.168.201.14@tcp:101: 00010000:00010000:1.0:1787359855.676955:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359855.676973:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce3c6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359855.677001:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359855.677012:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359855.677021:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a400, rc 0) 00000100:00100000:1.0:1787359855.677088:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:5589:x1874182508905856:12345-192.168.201.14@tcp:101: Request processed in 152us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.677095:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 122 00000100:00100000:0.0:1787359855.684701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359855.685262:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508905984 00000100:00100000:3.0:1787359855.685274:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508905984 00000100:00100000:3.0:1787359855.685339:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 123 00000100:00100000:3.0:1787359855.685350:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:5589:x1874182508905984:12345-192.168.201.14@tcp:501: 00000100:00100000:3.0:1787359855.685629:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:5589:x1874182508905984:12345-192.168.201.14@tcp:501: Request processed in 280us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359855.685638:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 123 00000100:00100000:2.0:1787359855.690262:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359855.690396:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906112 00000100:00100000:3.0:1787359855.690406:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906112 00000100:00100000:3.0:1787359855.690461:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 124 00000100:00100000:3.0:1787359855.690471:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:5589:x1874182508906112:12345-192.168.201.14@tcp:503: 00000100:00100000:1.0:1787359855.693297:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:5589:x1874182508906112:12345-192.168.201.14@tcp:503: Request processed in 2511us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.693312:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 124 00000100:00100000:3.0:1787359855.697116:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359855.697704:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906240 00000100:00100000:0.0:1787359855.697715:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906240 00000100:00100000:0.0:1787359855.697791:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 125 00000100:00100000:0.0:1787359855.697802:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:5613:x1874182508906240:12345-192.168.201.14@tcp:502: 00000100:00100000:2.0:1787359855.700854:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:5613:x1874182508906240:12345-192.168.201.14@tcp:502: Request processed in 3041us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359855.700871:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 125 00000100:00100000:3.0:1787359855.705345:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359855.705559:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906368 00000100:00100000:1.0:1787359855.705570:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906368 00000100:00100000:1.0:1787359855.705766:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 126 00000100:00100000:1.0:1787359855.705778:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:5613:x1874182508906368:12345-192.168.201.14@tcp:502: 00000100:00100000:1.0:1787359855.706229:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:5613:x1874182508906368:12345-192.168.201.14@tcp:502: Request processed in 452us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.706238:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 126 00000100:00100000:0.0:1787359855.713154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359855.713245:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906496 00000100:00100000:1.0:1787359855.713255:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906496 00000100:00100000:1.0:1787359855.713303:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:1.0:1787359855.713312:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1874182508906496:12345-192.168.201.14@tcp:38: 00010000:00080000:1.0:1787359855.713343:0:5862:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1787359855.713397:0:5862:0:(genops.c:1385:class_connect()) connect: client 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430, cookie 0x72f6de40e4ef36dd 00000004:00100000:1.0:1787359855.713428:0:5862:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787359855.713435:0:5862:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787359855.739444:0:5862:0:(import.c:65:import_set_state_nolock()) ffff983d407f9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359855.739534:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2361:x1874182508906496:12345-192.168.201.14@tcp:38: Request processed in 26220us (26389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359855.739545:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00010000:00010000:1.0:1787359856.678860:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359856.745268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359856.745391:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906624 00000100:00100000:1.0:1787359856.745408:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906624 00000100:00100000:1.0:1787359856.745573:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:1.0:1787359856.745585:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:0:x1874182508906624:12345-192.168.201.14@tcp:41: 00000004:00000024:1.0:1787359856.745628:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787359856.745924:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:0:x1874182508906624:12345-192.168.201.14@tcp:41: Request processed in 336us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359856.745937:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00080000:2.0:1787359856.746029:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359856.749037:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359856.749224:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906752 00000100:00100000:1.0:1787359856.749241:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906752 00000100:00100000:1.0:1787359856.749409:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:1.0:1787359856.749423:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5589:x1874182508906752:12345-192.168.201.14@tcp:41: 00000004:00000024:1.0:1787359856.749467:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787359856.749562:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5589:x1874182508906752:12345-192.168.201.14@tcp:41: Request processed in 142us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359856.749569:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:3.0:1787359856.753622:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359856.753799:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508906880 00000100:00100000:1.0:1787359856.753817:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508906880 00000100:00100000:1.0:1787359856.753909:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:1.0:1787359856.753925:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5589:x1874182508906880:12345-192.168.201.14@tcp:40: 00000100:00100000:1.0:1787359856.754413:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5589:x1874182508906880:12345-192.168.201.14@tcp:40: Request processed in 491us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359856.754424:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:3.0:1787359856.762477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359856.762529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359856.762566:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359856.762643:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907136 00000100:00100000:2.0:1787359856.762653:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907136 00000100:00100000:2.0:1787359856.762753:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 127 00000100:00100000:2.0:1787359856.762764:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:2362:x1874182508907136:12345-192.168.201.14@tcp:400: 00000100:00100000:3.0:1787359856.762772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359856.762794:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907008 00000100:00100000:3.0:1787359856.762797:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907008 00000100:00100000:3.0:1787359856.762816:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907264 00000100:00100000:3.0:1787359856.762819:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907264 00000100:00100000:3.0:1787359856.762829:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:3.0:1787359856.762836:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182508907008:12345-192.168.201.14@tcp:8: 00000100:00100000:2.0:1787359856.762836:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:2362:x1874182508907136:12345-192.168.201.14@tcp:400: Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359856.762843:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 127 00010000:00080000:3.0:1787359856.762860:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787359856.762892:0:6700:0:(genops.c:1385:class_connect()) connect: client 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430, cookie 0x72f6de40e4ef36e4 00002000:00100000:3.0:1787359856.762905:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430/ffff983d27d81000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787359856.762930:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787359856.763414:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787359856.763445:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983d27d82000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359856.763497:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2361:x1874182508907008:12345-192.168.201.14@tcp:8: Request processed in 660us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359856.763504:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:3.0:1787359856.763523:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:3.0:1787359856.763528:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182508907264:12345-192.168.201.14@tcp:8: 00010000:00080000:3.0:1787359856.763545:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1787359856.763562:0:6700:0:(genops.c:1385:class_connect()) connect: client 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430, cookie 0x72f6de40e4ef36eb 00002000:00100000:3.0:1787359856.763568:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430/ffff983d27d86800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787359856.763587:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787359856.763841:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787359856.763856:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983d27d84000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359856.763892:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2361:x1874182508907264:12345-192.168.201.14@tcp:8: Request processed in 362us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359856.763899:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:1.0:1787359856.765246:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907392 00000100:00100000:1.0:1787359856.765258:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907392 00000100:00100000:1.0:1787359856.765372:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:1.0:1787359856.765384:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5589:x1874182508907392:12345-192.168.201.14@tcp:33: 00000004:00080000:2.0:1787359856.788644:0:5864:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23173us 00000004:00200000:1.0:1787359856.823986:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787359856.824166:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5589:x1874182508907392:12345-192.168.201.14@tcp:33: Request processed in 58778us (61593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359856.824178:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:2.0:1787359857.104535:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359857.104652:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907520 00000100:00100000:1.0:1787359857.104663:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907520 00000100:00100000:1.0:1787359857.104778:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787359857.104793:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5630:x1874182508907520:12345-192.168.201.14@tcp:101: 00010000:00010000:1.0:1787359857.104814:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359857.104906:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a800/0x72f6de40e4ef36f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce3f0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359857.104978:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef36f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359857.105266:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef36f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359857.105285:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef36f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359857.105560:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787359857.105564:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359857.108930:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef36f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359857.108983:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a800/0x72f6de40e4ef36f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3f0 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359857.109005:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef36f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3f0 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359857.109015:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359857.109018:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787359857.109022:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165ac00, rc 0) 00000100:00100000:1.0:1787359857.109185:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:5630:x1874182508907520:12345-192.168.201.14@tcp:101: Request processed in 4392us (4737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359857.109194:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787359857.575020:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527803136:0@lo:13: 00000100:00100000:1.0:1787359857.575116:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359857.575305:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803136 00000100:00100000:0.0:1787359857.575313:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803136 00000100:00100000:0.0:1787359857.575377:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787359857.575386:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527803136:12345-0@lo:13: 00002000:00000024:0.0:1787359857.575408:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359857.575468:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527803136:12345-0@lo:13: Request processed in 83us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359857.575475:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787359857.575515:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40981880 x1874182527803136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359857.575535:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527803136:0@lo:13: 00000100:00080000:1.0:1787359857.575757:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359857.704541:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359858.727357:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359859.473609:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359859.474217:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907648 00000100:00100000:1.0:1787359859.474227:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907648 00000100:00100000:1.0:1787359859.474327:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:1.0:1787359859.474339:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:5682:x1874182508907648:12345-192.168.201.14@tcp:41: 00000004:00000024:1.0:1787359859.474389:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787359859.474468:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:5682:x1874182508907648:12345-192.168.201.14@tcp:41: Request processed in 130us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359859.474476:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00080000:2.0:1787359859.475168:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359859.483480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359859.486464:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907776 00000100:00100000:0.0:1787359859.486483:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907776 00000100:00100000:0.0:1787359859.486668:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:0.0:1787359859.486720:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5682:x1874182508907776:12345-192.168.201.14@tcp:13: 00002000:00000024:0.0:1787359859.486765:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359859.486882:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5682:x1874182508907776:12345-192.168.201.14@tcp:13: Request processed in 166us (3412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359859.486890:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:3.0:1787359859.490999:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359859.493157:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508907904 00000100:00100000:0.0:1787359859.493173:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508907904 00000100:00080000:2.0:1787359859.493287:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359859.493303:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359859.496045:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:0.0:1787359859.496066:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5682:x1874182508907904:12345-192.168.201.14@tcp:13: 00002000:00000024:0.0:1787359859.496107:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359859.496195:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:5682:x1874182508907904:12345-192.168.201.14@tcp:13: Request processed in 135us (5206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359859.496203:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00010000:00010000:1.0:1787359859.751122:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359860.135782:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527803392:0@lo:400: 00000100:00100000:2.0:1787359860.135854:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359860.135906:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527803904:0@lo:400: 00000100:00100000:2.0:1787359860.135932:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359860.135961:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359860.135967:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527803520:0@lo:400: 00000100:00100000:2.0:1787359860.135989:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359860.136020:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803904 00000100:00100000:2.0:1787359860.136034:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803904 00000100:00100000:2.0:1787359860.136098:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359860.136108:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527803904:12345-0@lo:400: 00000100:00100000:2.0:1787359860.136163:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527803904:12345-0@lo:400: Request processed in 57us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359860.136170:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787359860.136192:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803392 00000100:00100000:2.0:1787359860.136195:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803392 00000100:00100000:2.0:1787359860.136217:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803520 00000100:00100000:2.0:1787359860.136220:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803520 00000100:00100000:2.0:1787359860.136235:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787359860.136241:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527803392:12345-0@lo:400: 00000100:00100000:2.0:1787359860.136273:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527803392:12345-0@lo:400: Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359860.136279:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787359860.136291:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787359860.136297:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527803520:12345-0@lo:400: 00000100:00100000:2.0:1787359860.136320:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527803520:12345-0@lo:400: Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359860.136326:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787359860.136340:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359860.136345:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359860.136376:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527803520:0@lo:400: 00000100:00100000:2.0:1787359860.136388:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527803392:0@lo:400: 00010000:00080000:2.0:1787359860.136400:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e174a80 x1874182527803904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359860.136410:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527803904:0@lo:400: 00000100:00100000:3.0:1787359860.136604:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527803648:0@lo:400: 00000100:00100000:3.0:1787359860.136639:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359860.136698:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787359860.136705:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527803264:0@lo:400: 00000100:00100000:3.0:1787359860.136735:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359860.136760:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527803776:0@lo:400: 00000100:00100000:3.0:1787359860.136781:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359860.136843:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803648 00000100:00100000:0.0:1787359860.136848:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803648 00000100:00100000:1.0:1787359860.136916:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803264 00000100:00100000:1.0:1787359860.136921:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803264 00000100:00100000:0.0:1787359860.140153:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787359860.140170:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527803648:12345-0@lo:400: 00000100:00100000:0.0:1787359860.140249:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527803648:12345-0@lo:400: Request processed in 85us (3610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359860.140254:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787359860.140299:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e175880 x1874182527803648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359860.140310:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527803648:0@lo:400: 00000100:00100000:3.0:1787359860.140940:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527803776 00000100:00100000:3.0:1787359860.140964:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527803776 00000100:00100000:3.0:1787359860.141009:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359860.141017:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874182527803776:12345-0@lo:400: 00000100:00100000:3.0:1787359860.141072:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874182527803776:12345-0@lo:400: Request processed in 56us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359860.141079:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787359860.141103:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787359860.141107:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359860.142911:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527803776:0@lo:400: 00000100:00100000:1.0:1787359860.154265:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787359860.154288:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3317:x1874182527803264:12345-0@lo:400: 00000100:00100000:1.0:1787359860.154396:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3317:x1874182527803264:12345-0@lo:400: Request processed in 118us (17660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359860.154404:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787359860.155125:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527803264:0@lo:400: 00000100:00100000:2.0:1787359860.650921:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527804032:0@lo:13: 00000100:00100000:2.0:1787359860.650995:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359860.652371:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804032 00000100:00100000:0.0:1787359860.652384:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804032 00000100:00100000:0.0:1787359860.652458:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787359860.652467:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527804032:12345-0@lo:13: 00002000:00000024:0.0:1787359860.652491:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359860.655162:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527804032:12345-0@lo:13: Request processed in 2686us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359860.655177:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787359860.665604:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40981880 x1874182527804032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359860.665633:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527804032:0@lo:13: 00000001:00100000:3.0:1787359860.737795:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00010000:00010000:1.0:1787359860.774832:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787359861.266276:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000001:00100000:0.0:1787359861.287870:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00010000:00010000:2.0:1787359861.800164:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359861.853731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359861.853767:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908032 00000100:00100000:2.0:1787359861.853773:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359861.853778:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908032 00000100:00100000:2.0:1787359861.853809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359861.853838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359861.853840:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 129 00000100:00100000:3.0:1787359861.853851:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508908032:12345-192.168.201.14@tcp:400: 00000100:00100000:2.0:1787359861.853859:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908160 00000100:00100000:2.0:1787359861.853863:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908160 00000100:00100000:2.0:1787359861.853907:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:2.0:1787359861.853915:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508908160:12345-192.168.201.14@tcp:400: 00000100:00100000:3.0:1787359861.853925:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508908032:12345-192.168.201.14@tcp:400: Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359861.853934:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 129 00000100:00100000:2.0:1787359861.853943:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508908160:12345-192.168.201.14@tcp:400: Request processed in 30us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359861.853948:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00080000:2.0:1787359861.853964:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359861.854033:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908288 00000100:00100000:0.0:1787359861.854037:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908288 00000100:00100000:0.0:1787359861.854081:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908416 00000100:00100000:0.0:1787359861.854085:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908416 00000100:00100000:0.0:1787359861.854102:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:0.0:1787359861.854108:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508908288:12345-192.168.201.14@tcp:400: 00000100:00100000:0.0:1787359861.854147:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508908288:12345-192.168.201.14@tcp:400: Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359861.854154:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:0.0:1787359861.854168:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:0.0:1787359861.854175:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508908416:12345-192.168.201.14@tcp:400: 00000100:00100000:0.0:1787359861.854199:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508908416:12345-192.168.201.14@tcp:400: Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359861.854206:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00080000:2.0:1787359861.855181:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359861.855186:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1787359862.486787:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787359862.695424:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787359862.695454:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527804160:0@lo:13: 00000100:00100000:3.0:1787359862.695554:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359862.695824:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804160 00000100:00100000:1.0:1787359862.695832:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804160 00000100:00100000:1.0:1787359862.695896:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787359862.695906:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527804160:12345-0@lo:13: 00002000:00000024:1.0:1787359862.695940:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787359862.696235:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787359862.696271:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03ca80 x1874182527804160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359862.696289:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527804160:0@lo:13: 00000100:00100000:1.0:1787359862.696344:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527804160:12345-0@lo:13: Request processed in 439us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359862.696363:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787359862.822896:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359863.849974:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359864.871084:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359865.255317:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527804288:0@lo:400: 00000100:00100000:0.0:1787359865.255402:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359865.255467:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527804800:0@lo:400: 00000100:00100000:0.0:1787359865.255518:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359865.255544:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787359865.255550:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527804672:0@lo:400: 00000100:00100000:0.0:1787359865.255588:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359865.255625:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804672 00000100:00100000:0.0:1787359865.255632:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804672 00000100:00100000:0.0:1787359865.255720:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787359865.255730:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527804672:12345-0@lo:400: 00000100:00100000:0.0:1787359865.255785:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527804672:12345-0@lo:400: Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359865.255792:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787359865.255836:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409bb800 x1874182527804672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359865.255851:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527804672:0@lo:400: 00000100:00100000:2.0:1787359865.256229:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527804416:0@lo:400: 00000100:00100000:2.0:1787359865.256266:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359865.256299:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527804928:0@lo:400: 00000100:00100000:2.0:1787359865.256322:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359865.256349:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359865.256355:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527804544:0@lo:400: 00000100:00100000:2.0:1787359865.256388:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359865.256421:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804800 00000100:00100000:2.0:1787359865.256425:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804800 00000100:00100000:2.0:1787359865.256462:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804416 00000100:00100000:2.0:1787359865.256465:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804416 00000100:00100000:2.0:1787359865.256476:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804544 00000100:00100000:2.0:1787359865.256479:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804544 00000100:00100000:2.0:1787359865.256493:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787359865.256500:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527804800:12345-0@lo:400: 00000100:00100000:2.0:1787359865.256542:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527804800:12345-0@lo:400: Request processed in 43us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359865.256548:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787359865.256562:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359865.256568:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527804416:12345-0@lo:400: 00000100:00100000:2.0:1787359865.256610:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527804416:12345-0@lo:400: Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359865.256617:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359865.256629:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787359865.256635:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527804544:12345-0@lo:400: 00000100:00100000:2.0:1787359865.256662:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527804544:12345-0@lo:400: Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359865.256668:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359865.256811:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804928 00000100:00100000:1.0:1787359865.256816:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804928 00000100:00100000:1.0:1787359865.256846:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359865.256853:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527804928:12345-0@lo:400: 00000100:00100000:1.0:1787359865.256888:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527804928:12345-0@lo:400: Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359865.256894:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787359865.256963:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527804800:0@lo:400: 00000100:00100000:1.0:1787359865.256997:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527804544:0@lo:400: 00000100:00100000:1.0:1787359865.257007:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527804416:0@lo:400: 00010000:00080000:1.0:1787359865.257017:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9500 x1874182527804928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359865.257025:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527804928:0@lo:400: 00000100:00100000:3.0:1787359865.257271:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527804288 00000100:00100000:3.0:1787359865.257277:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527804288 00000100:00100000:3.0:1787359865.257314:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787359865.257322:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527804288:12345-0@lo:400: 00000100:00100000:3.0:1787359865.257383:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527804288:12345-0@lo:400: Request processed in 61us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359865.257389:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1787359865.257418:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359865.257422:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787359865.257424:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359865.257551:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527804288:0@lo:400: 00000100:00100000:0.0:1787359865.767042:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787359865.767069:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527805056:0@lo:13: 00000100:00100000:0.0:1787359865.767140:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359865.767213:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527805056 00000100:00100000:0.0:1787359865.767221:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527805056 00000100:00100000:0.0:1787359865.767268:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787359865.767278:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527805056:12345-0@lo:13: 00002000:00000024:0.0:1787359865.767313:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359865.767357:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527805056:12345-0@lo:13: Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359865.767363:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787359865.767401:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40980e00 x1874182527805056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359865.767438:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527805056:0@lo:13: 00010000:00010000:1.0:1787359865.894784:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787359866.065738:0:8452:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff812a8ff0 20000000:00000080:0.0:1787359866.065755:0:8452:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983d39af3000 uarg=0000000000000000 20000000:01000000:0.0:1787359866.065794:0:8452:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787359866.065797:0:8452:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787359866.065800:0:8452:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787359866.065805:0:8452:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787359866.065810:0:8452:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787359866.065825:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787359866.065827:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787359866.066039:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787359866.066042:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787359866.071422:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787359866.071985:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787359866.072047:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787359866.072075:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787359866.072086:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787359866.072089:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787359866.073335:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787359866.074034:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787359866.074081:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787359866.074116:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787359866.074129:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787359866.074131:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787359866.078724:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787359866.079364:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787359866.079427:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787359866.079483:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787359866.079497:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787359866.079501:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787359866.081131:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787359866.081833:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787359866.081902:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787359866.081954:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1787359866.081975:0:8452:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787359866.081994:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082012:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082019:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082025:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082031:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082038:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082044:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082050:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082070:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082076:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082084:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082126:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082141:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 9 pid: 5856 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082165:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805184:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359866.082607:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082617:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 9 pid: 5853 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082627:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805312:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359866.082664:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082672:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 18 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082726:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805440:0@lo:104: 00000100:00100000:1.0:1787359866.082770:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787359866.082804:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082813:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 18 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082821:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805568:0@lo:104: 00000100:00100000:1.0:1787359866.082846:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787359866.082872:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082880:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 18 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082889:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805696:0@lo:104: 00010000:00010000:1.0:1787359866.082916:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082936:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 18 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082945:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805824:0@lo:104: 00010000:00010000:1.0:1787359866.082971:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.082979:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 18 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.082996:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805952:0@lo:104: 00010000:00010000:1.0:1787359866.083025:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.083034:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 18 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.083042:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527806080:0@lo:104: 00010000:00010000:1.0:1787359866.083087:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.083096:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 18 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.083106:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527806208:0@lo:104: 00000100:00100000:1.0:1787359866.083124:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787359866.087362:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787359866.087412:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.087572:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.087583:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.087592:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.087601:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.087612:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527805440 00000100:00100000:3.0:1787359866.087619:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527805440 00000100:00100000:3.0:1787359866.087658:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527805568 00000100:00100000:3.0:1787359866.087661:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527805568 00000100:00100000:3.0:1787359866.087671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527805696 00000100:00100000:3.0:1787359866.087673:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527805696 00000100:00100000:3.0:1787359866.087711:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527805824 00000100:00100000:3.0:1787359866.087714:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527805824 00000100:00100000:3.0:1787359866.087722:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527805952 00000100:00100000:3.0:1787359866.087724:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527805952 00000100:00100000:3.0:1787359866.087734:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806080 00000100:00100000:3.0:1787359866.087736:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806080 00000100:00100000:3.0:1787359866.087745:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806208 00000100:00100000:3.0:1787359866.087747:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806208 00000100:00100000:3.0:1787359866.087759:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787359866.087767:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+9:8452:x1874182527805440:12345-0@lo:104: 00010000:00010000:3.0:1787359866.087784:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.087868:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787359866.087886:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+9:8452:x1874182527805440:12345-0@lo:104: Request processed in 120us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.087893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787359866.087911:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787359866.087917:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+8:8452:x1874182527805568:12345-0@lo:104: 00010000:00010000:3.0:1787359866.087925:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.087957:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787359866.087962:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27fb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+8:8452:x1874182527805568:12345-0@lo:104: Request processed in 46us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.087967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787359866.087995:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359866.088000:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+7:8452:x1874182527805696:12345-0@lo:104: 00010000:00010000:3.0:1787359866.088007:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088034:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787359866.088039:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+7:8452:x1874182527805696:12345-0@lo:104: Request processed in 40us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.088045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359866.088056:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359866.088061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+6:8452:x1874182527805824:12345-0@lo:104: 00010000:00010000:3.0:1787359866.088068:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088091:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787359866.088101:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+6:8452:x1874182527805824:12345-0@lo:104: Request processed in 40us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.088106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359866.088118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359866.088124:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+5:8452:x1874182527805952:12345-0@lo:104: 00010000:00010000:3.0:1787359866.088131:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088159:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787359866.088164:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+5:8452:x1874182527805952:12345-0@lo:104: Request processed in 41us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.088170:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359866.088182:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787359866.088188:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+4:8452:x1874182527806080:12345-0@lo:104: 00010000:00010000:3.0:1787359866.088195:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088221:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787359866.088225:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+4:8452:x1874182527806080:12345-0@lo:104: Request processed in 38us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.088231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787359866.088243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359866.088248:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:8452:x1874182527806208:12345-0@lo:104: 00010000:00010000:3.0:1787359866.088256:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088281:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787359866.088292:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:8452:x1874182527806208:12345-0@lo:104: Request processed in 44us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.088298:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787359866.088327:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787359866.088333:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088340:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359866.088345:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088354:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359866.088361:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359866.088367:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359866.088405:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.088412:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359866.089022:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089031:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef36ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef36b3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089046:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787359866.089050:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089067:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01677400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359866.089070:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089076:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359866.089081:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359866.089086:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359866.089102:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089109:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359866.089114:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089119:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef3682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3689 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089128:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787359866.089132:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.089136:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41200 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359866.089139:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.090042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359866.090078:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359866.090133:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908544 00000100:00100000:1.0:1787359866.090140:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908544 00010000:00010000:3.0:1787359866.090177:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359866.090184:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359866.090189:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359866.090216:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090222:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359866.090237:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090242:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41200/0x72f6de40e4ef3666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef366d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090253:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787359866.090256:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090261:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359866.090264:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090270:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359866.090276:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359866.090287:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359866.090301:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090308:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359866.090313:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090319:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef365f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090328:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787359866.090332:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090337:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63600 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359866.090340:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090346:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359866.090353:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359866.090358:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359866.090370:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090376:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359866.090389:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090395:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef364a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3651 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090403:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787359866.090406:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.090412:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359866.090415:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.090451:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 10 pid: 5856 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.090486:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908672 00000100:00100000:1.0:1787359866.090490:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908672 00010000:00010000:1.0:1787359866.090504:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 11 pid: 5853 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.090533:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:1.0:1787359866.090541:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03658e77-9945-4faf-b424-380f2de8cb18+11:2363:x1874182508908544:12345-192.168.201.14@tcp:103: 00010000:00010000:1.0:1787359866.090554:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359866.090569:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 11 pid: 5856 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.090581:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 11 pid: 5856 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.090599:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359866.090768:0:5848:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787359866.090776:0:5848:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787359866.090899:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03658e77-9945-4faf-b424-380f2de8cb18+11:2363:x1874182508908544:12345-192.168.201.14@tcp:103: Request processed in 357us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359866.090907:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:1.0:1787359866.090924:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:1.0:1787359866.090930:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508908672:12345-192.168.201.14@tcp:103: 00010000:00010000:1.0:1787359866.090938:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359866.090942:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 10 pid: 5853 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.090951:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 10 pid: 5853 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.090961:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359866.090981:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508908672:12345-192.168.201.14@tcp:103: Request processed in 51us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359866.090987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00010000:00010000:1.0:1787359866.091035:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b63a00/0x72f6de40e4ef36c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce395 expref: 9 pid: 5856 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.091045:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805184:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359866.091054:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef36c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce38e expref: 8 pid: 5853 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.091063:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805312:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359866.091072:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805440:0@lo:104: 00000100:00100000:1.0:1787359866.091079:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805568:0@lo:104: 00000100:00100000:1.0:1787359866.091086:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805696:0@lo:104: 00000100:00100000:1.0:1787359866.091093:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805824:0@lo:104: 00000100:00100000:1.0:1787359866.091100:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527805952:0@lo:104: 00000100:00100000:1.0:1787359866.091107:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527806080:0@lo:104: 00000100:00100000:1.0:1787359866.091113:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874182527806208:0@lo:104: 00010000:00010000:1.0:1787359866.091144:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359866.092189:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527806464:0@lo:103: 00000100:00100000:2.0:1787359866.092267:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359866.092322:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787359866.092329:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527806336:0@lo:103: 00000100:00100000:2.0:1787359866.092359:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359866.092378:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527806848:0@lo:103: 00000100:00100000:2.0:1787359866.092397:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359866.092420:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359866.092426:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092434:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165ae00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787359866.092438:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092446:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359866.092452:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359866.092458:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787359866.092484:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092490:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787359866.092502:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092508:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef35f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef35fd expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092521:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359866.092522:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359866.092529:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359866.092537:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359866.092549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806464 00000100:00100000:2.0:1787359866.092565:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806464 00010000:00010000:2.0:1787359866.092589:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 19 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359866.092607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806336 00000100:00100000:2.0:1787359866.092610:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806336 00010000:00010000:2.0:1787359866.092621:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 20 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359866.092632:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806848 00000100:00100000:2.0:1787359866.092634:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806848 00010000:00010000:2.0:1787359866.092646:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 21 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359866.092658:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787359866.092665:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+21:3318:x1874182527806464:12345-0@lo:103: 00010000:00010000:2.0:1787359866.092674:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359866.092696:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 21 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092705:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 21 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092718:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676400/0x72f6de40e4ef3689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3682 expref: 21 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092730:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359866.092766:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3318:x1874182527806464:12345-0@lo:103: Request processed in 102us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.092781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787359866.092798:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787359866.092804:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527806336:12345-0@lo:103: 00010000:00010000:2.0:1787359866.092811:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359866.092815:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 19 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092823:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 19 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092833:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40400/0x72f6de40e4ef36b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef36ac expref: 19 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092840:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359866.092862:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:3318:x1874182527806336:12345-0@lo:103: Request processed in 59us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.092868:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787359866.092879:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787359866.092884:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3318:x1874182527806848:12345-0@lo:103: 00010000:00010000:2.0:1787359866.092891:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359866.092895:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 17 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092903:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 17 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092912:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef3651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef364a expref: 17 pid: 5855 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.092930:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359866.092953:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3318:x1874182527806848:12345-0@lo:103: Request processed in 68us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.092958:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787359866.092975:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359866.092983:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527806976:0@lo:103: 00000100:00100000:2.0:1787359866.093009:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359866.093043:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527806336:0@lo:103: 00000100:00100000:2.0:1787359866.093050:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527806848:0@lo:103: 00000100:00100000:2.0:1787359866.093057:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527806464:0@lo:103: 00000100:00100000:2.0:1787359866.093078:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806976 00000100:00100000:2.0:1787359866.093082:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806976 00010000:00010000:2.0:1787359866.093095:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 16 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359866.093108:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787359866.093113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3317:x1874182527806976:12345-0@lo:103: 00010000:00010000:2.0:1787359866.093121:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359866.093124:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 16 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.093132:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 16 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.093141:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef35fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef35f6 expref: 16 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.093160:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359866.093188:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:3317:x1874182527806976:12345-0@lo:103: Request processed in 74us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.093194:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787359866.093218:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527806976:0@lo:103: 00010000:00010000:3.0:1787359866.093266:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359866.093275:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359866.093280:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787359866.093299:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.093304:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359866.093310:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.093316:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41800/0x72f6de40e4ef3620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3627 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.093330:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359866.093338:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359866.093340:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359866.093359:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527806592:0@lo:103: 00000100:00100000:3.0:1787359866.093388:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.093415:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527807104:0@lo:103: 00000100:00100000:1.0:1787359866.093552:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806592 00000100:00100000:1.0:1787359866.093565:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806592 00010000:00010000:1.0:1787359866.093584:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359866.093600:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359866.093607:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:3319:x1874182527806592:12345-0@lo:103: 00010000:00010000:1.0:1787359866.093614:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359866.093624:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.093633:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.093644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef366d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3666 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.093653:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359866.093894:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3319:x1874182527806592:12345-0@lo:103: Request processed in 287us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359866.093902:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359866.097205:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359866.097301:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527806592:0@lo:103: 00000100:00100000:3.0:1787359866.097318:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359866.097329:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527806720:0@lo:103: 00000100:00100000:3.0:1787359866.097354:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359866.097555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807104 00000100:00100000:0.0:1787359866.097571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807104 00010000:00010000:0.0:1787359866.097607:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 14 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359866.097630:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527806720 00000100:00100000:0.0:1787359866.097633:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527806720 00010000:00010000:0.0:1787359866.097643:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359866.097706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787359866.097715:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:3319:x1874182527807104:12345-0@lo:103: 00010000:00010000:0.0:1787359866.097729:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359866.097734:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097815:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097836:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a600/0x72f6de40e4ef3627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3620 expref: 15 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097853:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359866.097900:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3319:x1874182527807104:12345-0@lo:103: Request processed in 186us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359866.097908:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787359866.097917:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527807104:0@lo:103: 00000100:00100000:0.0:1787359866.097926:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787359866.097932:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:3319:x1874182527806720:12345-0@lo:103: 00010000:00010000:0.0:1787359866.097941:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359866.097946:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 13 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097956:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 13 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097965:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef365f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3658 expref: 13 pid: 5853 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097988:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.097996:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098010:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098017:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098023:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098029:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098035:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787359866.098039:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098045:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098325:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359866.098336:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359866.098375:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+12:3319:x1874182527806720:12345-0@lo:103: Request processed in 443us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359866.098391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787359866.098449:0:8452:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.098526:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359866.098533:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3700 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359866.098994:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527806720:0@lo:103: 00000100:00100000:2.0:1787359866.636119:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359866.636210:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908800 00000100:00100000:3.0:1787359866.636220:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908800 00000100:00100000:3.0:1787359866.636280:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 131 00000100:00100000:3.0:1787359866.636291:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+8:5603:x1874182508908800:12345-192.168.201.14@tcp:101: 00010000:00010000:3.0:1787359866.636307:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359866.636327:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef3707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce3f7 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.636354:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef3707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3f7 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.636365:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef3707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3f7 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359866.636373:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63600, rc 0) 00000100:00100000:3.0:1787359866.638124:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508908800:12345-192.168.201.14@tcp:101: Request processed in 1823us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.638135:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 131 00000100:00100000:2.0:1787359866.646658:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359866.646794:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508908928 00000100:00100000:3.0:1787359866.646806:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508908928 00000100:00100000:3.0:1787359866.646870:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 132 00000100:00100000:3.0:1787359866.646881:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508908928:12345-192.168.201.14@tcp:501: 00000100:00100000:3.0:1787359866.647245:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508908928:12345-192.168.201.14@tcp:501: Request processed in 364us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.647254:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 132 00000100:00100000:1.0:1787359866.653761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359866.653978:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909056 00000100:00100000:3.0:1787359866.653990:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909056 00000100:00100000:3.0:1787359866.654095:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 133 00000100:00100000:3.0:1787359866.654106:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508909056:12345-192.168.201.14@tcp:503: 00000100:00100000:3.0:1787359866.654359:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508909056:12345-192.168.201.14@tcp:503: Request processed in 253us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.654367:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 133 00000100:00100000:1.0:1787359866.660263:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359866.660426:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909184 00000100:00100000:2.0:1787359866.660435:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909184 00000100:00100000:2.0:1787359866.660536:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 134 00000100:00100000:2.0:1787359866.660555:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+9:6070:x1874182508909184:12345-192.168.201.14@tcp:502: 00000100:00100000:2.0:1787359866.660859:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+9:6070:x1874182508909184:12345-192.168.201.14@tcp:502: Request processed in 313us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.660867:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 134 00000100:00100000:0.0:1787359866.670181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359866.670378:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909312 00000100:00100000:3.0:1787359866.670388:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909312 00000100:00100000:3.0:1787359866.670463:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 135 00000100:00100000:3.0:1787359866.670475:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:6070:x1874182508909312:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787359866.670930:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:6070:x1874182508909312:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 455us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.670938:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 135 00000100:00100000:1.0:1787359866.673720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359866.673888:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909440 00000100:00100000:2.0:1787359866.673898:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909440 00000100:00100000:2.0:1787359866.673963:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 136 00000100:00100000:2.0:1787359866.673974:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508909440:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359866.673990:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359866.674009:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d00030e00/0x72f6de40e4ef370e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce3fe expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.674038:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d00030e00/0x72f6de40e4ef370e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3fe expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.674049:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d00030e00/0x72f6de40e4ef370e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3fe expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359866.674073:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d00030e00, rc 0) 00000100:00100000:2.0:1787359866.674139:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508909440:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 167us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.674147:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 136 00000100:00100000:1.0:1787359866.676224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359866.676364:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909568 00000100:00100000:2.0:1787359866.676374:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909568 00000100:00100000:2.0:1787359866.676433:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 137 00000100:00100000:2.0:1787359866.676554:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508909568:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359866.677082:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508909568:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 640us (866us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787359866.677091:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 137 00010000:00010000:2.0:1787359866.919026:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359866.954394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359866.954448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359866.954488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359866.954512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359866.954559:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909952 00000100:00100000:0.0:1787359866.954569:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909952 00000100:00100000:0.0:1787359866.954629:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910080 00000100:00100000:0.0:1787359866.954632:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910080 00000100:00100000:0.0:1787359866.954652:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:0.0:1787359866.954662:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508909952:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359866.954779:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508909952:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 118us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359866.954787:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:0.0:1787359866.954806:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:0.0:1787359866.954812:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508910080:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359866.954837:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508910080:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359866.954844:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00080000:0.0:1787359866.954859:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787359866.954863:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359866.955120:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909824 00000100:00100000:2.0:1787359866.955126:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909824 00000100:00100000:2.0:1787359866.955192:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:2.0:1787359866.955200:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508909824:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359866.955234:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508909824:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 34us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359866.955241:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00080000:0.0:1787359866.955711:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359866.957274:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508909696 00000100:00100000:3.0:1787359866.957287:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508909696 00000100:00100000:3.0:1787359866.957369:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 138 00000100:00100000:3.0:1787359866.957379:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508909696:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359866.958000:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508909696:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 621us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359866.958010:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 138 10000000:01000000:3.0:1787359867.431051:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787359867.431059:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d11588000 from 39 10000000:01000000:3.0:1787359867.431065:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787359867.431115:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.431138:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.431150:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359867.431179:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807232:0@lo:101: 00000100:00100000:3.0:1787359867.431249:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.431317:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f8513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.431830:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807232 00000100:00100000:2.0:1787359867.431837:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807232 00000100:00100000:2.0:1787359867.431894:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787359867.431903:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+12:5858:x1874182527807232:12345-0@lo:101: 00010000:00010000:2.0:1787359867.431916:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359867.431942:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef371c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3715 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.431965:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef371c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3715 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.431976:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef371c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3715 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.431986:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d00030c00, rc 0) 00000100:00100000:2.0:1787359867.434004:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527807232:12345-0@lo:101: Request processed in 2094us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.434017:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787359867.438177:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807232:0@lo:101: 00010000:00010000:1.0:1787359867.438209:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.438221:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359867.438305:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807360:0@lo:501: 00000100:00100000:1.0:1787359867.438362:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.438965:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.446576:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807360 00000100:00100000:3.0:1787359867.446592:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807360 00000100:00100000:3.0:1787359867.447635:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787359867.447662:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527807360:12345-0@lo:501: 00000100:00100000:3.0:1787359867.448010:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527807360:12345-0@lo:501: Request processed in 343us (9638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.448020:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787359867.448176:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807360:0@lo:501: 00000100:00100000:1.0:1787359867.448222:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807488:0@lo:503: 00000100:00100000:1.0:1787359867.448272:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.454585:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.454651:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807488 00000100:00100000:2.0:1787359867.454661:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807488 00000100:00100000:2.0:1787359867.454740:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787359867.454750:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527807488:12345-0@lo:503: 00000100:00100000:2.0:1787359867.454993:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527807488:12345-0@lo:503: Request processed in 244us (6720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.455012:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787359867.455768:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807488:0@lo:503: 00000100:00100000:2.0:1787359867.455979:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8471:1874182527807616:0@lo:502: 00000100:00100000:2.0:1787359867.456147:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359867.456177:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807616 00000100:00100000:2.0:1787359867.456182:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807616 00000100:00100000:2.0:1787359867.456209:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787359867.456217:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:8471:x1874182527807616:12345-0@lo:502: 00000100:00100000:2.0:1787359867.456423:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:8471:x1874182527807616:12345-0@lo:502: Request processed in 206us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.456437:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787359867.456484:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.456496:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8471:1874182527807616:0@lo:502: 00000100:00100000:2.0:1787359867.456543:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8471:1874182527807744:0@lo:502: 00000100:00100000:2.0:1787359867.456575:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359867.456594:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807744 00000100:00100000:2.0:1787359867.456597:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807744 00000100:00100000:2.0:1787359867.456613:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787359867.456618:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:8471:x1874182527807744:12345-0@lo:502: 00000100:00100000:2.0:1787359867.456988:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:8471:x1874182527807744:12345-0@lo:502: Request processed in 368us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.456995:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787359867.457095:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.457110:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8471:1874182527807744:0@lo:502: 00000040:00080000:2.0:1787359867.457131:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787359867.457187:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787359867.457205:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787359867.457215:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.457226:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359867.457237:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787359867.457240:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787359867.457243:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787359867.457270:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.457278:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.457287:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359867.457300:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807872:0@lo:101: 00000100:00100000:2.0:1787359867.457325:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359867.457340:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.457352:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527807872 00000100:00100000:2.0:1787359867.457356:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527807872 00000100:00100000:2.0:1787359867.457373:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787359867.457379:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+13:5858:x1874182527807872:12345-0@lo:101: 00010000:00010000:2.0:1787359867.457388:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359867.457595:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d00030000/0x72f6de40e4ef372a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3723 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.457616:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d00030000/0x72f6de40e4ef372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3723 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.457625:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d00030000/0x72f6de40e4ef372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3723 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.457633:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d00030000, rc 0) 00000100:00100000:2.0:1787359867.458134:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527807872:12345-0@lo:101: Request processed in 752us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.458141:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787359867.458203:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527807872:0@lo:101: 00010000:00010000:2.0:1787359867.458215:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359867.458225:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359867.458274:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808000:0@lo:501: 00000100:00100000:2.0:1787359867.458299:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359867.458324:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.458335:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808000 00000100:00100000:2.0:1787359867.458339:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808000 00000100:00100000:2.0:1787359867.458362:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787359867.458369:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527808000:12345-0@lo:501: 00000100:00100000:2.0:1787359867.464506:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527808000:12345-0@lo:501: Request processed in 6125us (6194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.464520:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787359867.464859:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808000:0@lo:501: 00000100:00100000:3.0:1787359867.464926:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808128:0@lo:503: 00000100:00100000:3.0:1787359867.464991:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.465106:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.465125:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808128 00000100:00100000:3.0:1787359867.465131:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808128 00000100:00100000:3.0:1787359867.465168:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787359867.465177:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527808128:12345-0@lo:503: 00000100:00100000:3.0:1787359867.465367:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527808128:12345-0@lo:503: Request processed in 190us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.465375:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787359867.465561:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808128:0@lo:503: 00000100:00100000:3.0:1787359867.467885:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8472:1874182527808256:0@lo:502: 00000100:00100000:3.0:1787359867.467965:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.468207:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.476963:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808256 00000100:00100000:2.0:1787359867.476980:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808256 00000100:00100000:2.0:1787359867.477205:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787359867.477215:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8472:x1874182527808256:12345-0@lo:502: 00000100:00100000:2.0:1787359867.477490:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8472:x1874182527808256:12345-0@lo:502: Request processed in 276us (9525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.477498:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787359867.477637:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8472:1874182527808256:0@lo:502: 00000020:01000000:3.0:1787359867.477670:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359867.479141:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359867.479148:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787359867.479158:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787359867.479207:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8472:1874182527808384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.479277:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.483059:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.489502:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808384 00000100:00100000:1.0:1787359867.489515:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808384 00000100:00100000:1.0:1787359867.489590:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787359867.489600:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8472:x1874182527808384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.490314:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:8472:x1874182527808384:12345-0@lo:502:llog_process_th.0 Request processed in 714us (11035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.490323:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787359867.490512:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8472:1874182527808384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787359867.490559:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359867.490567:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359867.490569:0:8472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787359867.490574:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787359867.490896:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787359867.490914:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787359867.490924:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.490935:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359867.490946:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787359867.490948:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d200eb000 from 39 10000000:01000000:3.0:1787359867.490951:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787359867.490981:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.490989:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.490999:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359867.491976:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.492172:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.492217:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.492314:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808512 00000100:00100000:1.0:1787359867.492322:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808512 00000100:00100000:1.0:1787359867.492374:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787359867.492383:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:5858:x1874182527808512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359867.492471:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359867.492488:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165be00/0x72f6de40e4ef3738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3731 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.492513:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165be00/0x72f6de40e4ef3738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3731 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.492558:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165be00/0x72f6de40e4ef3738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3731 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.492567:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165be00, rc 0) 00000100:00100000:1.0:1787359867.492605:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527808512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.492612:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787359867.492894:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359867.492909:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.492918:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359867.492989:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.493925:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.493962:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.493986:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808640 00000100:00100000:3.0:1787359867.493992:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808640 00000100:00100000:2.0:1787359867.494787:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787359867.494864:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527808640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359867.496637:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527808640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1835us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.496649:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787359867.496948:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.497127:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.497180:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.497216:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.497281:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808768 00000100:00100000:1.0:1787359867.497288:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808768 00000100:00100000:1.0:1787359867.497334:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787359867.497343:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527808768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.497513:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527808768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.497520:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787359867.498921:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527808768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.501289:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8473:1874182527808896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.501380:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.502198:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44840 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.502287:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527808896 00000100:00100000:2.0:1787359867.502295:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527808896 00000100:00100000:2.0:1787359867.502338:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787359867.502347:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8473:x1874182527808896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359867.502643:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8473:x1874182527808896:12345-0@lo:502:llog_process_th.0 Request processed in 295us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.502651:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787359867.502910:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8473:1874182527808896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.503354:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8473:1874182527809024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.503411:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.504855:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44840 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.512925:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809024 00000100:00100000:1.0:1787359867.512939:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809024 00000100:00100000:1.0:1787359867.513020:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787359867.513031:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8473:x1874182527809024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.513548:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+15:8473:x1874182527809024:12345-0@lo:502:llog_process_th.0 Request processed in 517us (10135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.513557:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787359867.513671:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8473:1874182527809024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787359867.514886:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787359867.516487:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787359867.516519:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787359867.516543:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.516571:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359867.516583:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787359867.516586:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787359867.516589:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787359867.516627:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.516635:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.516645:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359867.516669:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359867.518132:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359867.518176:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0831fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.518343:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809152 00000100:00100000:1.0:1787359867.518352:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809152 00000100:00100000:1.0:1787359867.518406:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787359867.518415:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+15:5858:x1874182527809152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359867.519258:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359867.519281:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef3746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef373f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.519311:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef3746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef373f expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.519322:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef3746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef373f expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.519331:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165b800, rc 0) 00000100:00100000:1.0:1787359867.519438:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527809152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1022us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.519446:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787359867.527991:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359867.528032:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.528046:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359867.528444:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.528503:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.528556:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359867.528611:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809280 00000100:00100000:0.0:1787359867.528618:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809280 00000100:00100000:0.0:1787359867.528665:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787359867.529139:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527809280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359867.529400:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527809280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.530623:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.530674:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.530767:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.530818:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44840 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.530839:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809408 00000100:00100000:3.0:1787359867.530844:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809408 00000100:00100000:0.0:1787359867.534870:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787359867.539883:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787359867.539902:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527809408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359867.540176:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527809408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (9408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359867.540187:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787359867.540546:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.542620:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8477:1874182527809536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.542829:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.542907:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.543866:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809536 00000100:00100000:2.0:1787359867.543877:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809536 00000100:00100000:0.0:1787359867.544280:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787359867.544294:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8477:x1874182527809536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359867.544562:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8477:x1874182527809536:12345-0@lo:502:llog_process_th.0 Request processed in 272us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359867.544571:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787359867.544852:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8477:1874182527809536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359867.544884:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359867.544894:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359867.544896:0:8477:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787359867.544902:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787359867.544933:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8477:1874182527809664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.544975:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.545022:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787359867.548688:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809664 00000100:00100000:0.0:1787359867.548705:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809664 00000100:00100000:0.0:1787359867.549175:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787359867.549184:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8477:x1874182527809664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359867.549453:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:8477:x1874182527809664:12345-0@lo:502:llog_process_th.0 Request processed in 269us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359867.549461:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787359867.549611:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8477:1874182527809664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359867.549644:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359867.549651:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359867.549654:0:8477:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787359867.549658:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787359867.550988:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787359867.551634:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787359867.551647:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.551699:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359867.551778:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787359867.551781:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d0dccf000 from 39 10000000:01000000:0.0:1787359867.551784:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787359867.552163:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.552172:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.552184:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359867.552208:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359867.552270:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359867.552336:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.552450:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809792 00000100:00100000:1.0:1787359867.552459:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809792 00000100:00100000:1.0:1787359867.552510:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787359867.552519:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527809792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359867.552543:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359867.552558:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef374d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.552580:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef374d expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.552590:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef374d expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.552601:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a800, rc 0) 00000100:00100000:1.0:1787359867.552642:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527809792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.552649:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787359867.553931:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359867.553956:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359867.553967:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359867.554051:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359867.554918:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359867.554967:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.555032:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527809920 00000100:00100000:2.0:1787359867.555039:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527809920 00000100:00100000:2.0:1787359867.555159:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787359867.555168:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527809920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359867.555489:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527809920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.555497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787359867.562882:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40980700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527809920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.562945:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.563033:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.563247:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787359867.563360:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810048 00000100:00100000:2.0:1787359867.563367:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810048 00000100:00100000:2.0:1787359867.563420:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787359867.563429:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527810048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359867.563647:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527810048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359867.563655:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787359867.563974:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.565084:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8479:1874182527810176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.565144:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.565186:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.566351:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810176 00000100:00100000:1.0:1787359867.566360:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810176 00000100:00100000:1.0:1787359867.566414:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787359867.566424:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8479:x1874182527810176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.566703:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8479:x1874182527810176:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.566718:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787359867.566874:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8479:1874182527810176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.566925:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8479:1874182527810304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.566961:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.566987:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.569055:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810304 00000100:00100000:1.0:1787359867.569074:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810304 00000100:00100000:1.0:1787359867.569129:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787359867.569138:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8479:x1874182527810304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.569385:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8479:x1874182527810304:12345-0@lo:502:llog_process_th.0 Request processed in 247us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.569393:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787359867.569633:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8479:1874182527810304:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787359867.569667:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787359867.571352:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787359867.571383:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787359867.571394:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.571405:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359867.571417:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787359867.571419:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787359867.571422:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787359867.571459:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.571478:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.571489:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359867.571514:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.571587:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.571632:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.571707:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810432 00000100:00100000:3.0:1787359867.571723:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810432 00000100:00100000:3.0:1787359867.571765:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787359867.571773:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527810432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359867.571785:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359867.571806:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef3762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef375b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.571829:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef3762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef375b expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.571840:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef3762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef375b expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359867.571855:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62a00, rc 0) 00000100:00100000:3.0:1787359867.571893:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527810432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.571899:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787359867.572210:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359867.572224:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.572234:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359867.572284:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.572311:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.572334:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.572579:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810560 00000100:00100000:3.0:1787359867.572584:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810560 00000100:00100000:3.0:1787359867.572610:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787359867.572618:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527810560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359867.572895:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527810560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.572903:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787359867.574850:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359867.574906:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40986a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359867.574972:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359867.575024:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851540 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.578839:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810688 00000100:00100000:1.0:1787359867.578856:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810688 00000100:00100000:1.0:1787359867.578930:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787359867.578941:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527810688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.579330:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527810688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 390us (4356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.579338:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787359867.579433:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40986a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527810688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359867.584180:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40986a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8480:1874182527810816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359867.584281:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359867.584334:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787359867.584506:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810816 00000100:00100000:3.0:1787359867.584514:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810816 00000100:00100000:3.0:1787359867.584571:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787359867.584581:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8480:x1874182527810816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359867.584860:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8480:x1874182527810816:12345-0@lo:502:llog_process_th.0 Request processed in 280us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.584869:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787359867.584987:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40986a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8480:1874182527810816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359867.585031:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359867.585041:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359867.585043:0:8480:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787359867.585048:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787359867.585072:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8480:1874182527810944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.585109:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.585133:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527810944 00000100:00100000:1.0:1787359867.585137:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527810944 00000100:00100000:1.0:1787359867.585159:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787359867.585165:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8480:x1874182527810944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359867.585283:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8480:x1874182527810944:12345-0@lo:502:llog_process_th.0 Request processed in 118us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.585291:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787359867.585327:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.585338:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8480:1874182527810944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359867.585353:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359867.585357:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359867.585358:0:8480:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787359867.585362:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787359867.585416:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787359867.585431:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787359867.585441:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585452:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359867.585472:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787359867.585474:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff983d111f3370 from 1 10000000:01000000:1.0:1787359867.585477:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787359867.585499:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585507:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585514:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359867.585527:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527811072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.585562:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.585574:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.585585:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811072 00000100:00100000:1.0:1787359867.585589:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811072 00000100:00100000:1.0:1787359867.585604:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787359867.585610:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527811072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359867.585617:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359867.585628:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef3770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3769 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585647:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef3770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3769 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585658:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef3770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3769 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585699:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165b400, rc 0) 00000100:00100000:1.0:1787359867.585728:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527811072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359867.585734:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787359867.585761:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527811072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359867.585773:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.585781:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359867.585821:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527811200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.585844:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359867.585855:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787359867.585865:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811200 00000100:00100000:1.0:1787359867.585868:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811200 00000100:00100000:1.0:1787359867.585882:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787359867.585887:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527811200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359867.586073:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527811200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (227us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787359867.586079:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787359867.586106:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527811200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787359867.586120:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787359867.586125:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359867.586138:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359867.816016:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787359867.816037:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527811328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359867.816101:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359867.816168:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811328 00000100:00100000:3.0:1787359867.816175:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811328 00000100:00100000:3.0:1787359867.816228:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359867.816237:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527811328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787359867.816281:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359867.816325:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527811328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359867.816332:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787359867.816352:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787359867.816379:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9c00 x1874182527811328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359867.816397:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527811328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787359867.943107:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787359868.214157:0:8512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbc904030 20000000:00000080:2.0:1787359868.214174:0:8512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983d27cd8800 uarg=0000000000000000 20000000:01000000:2.0:1787359868.214209:0:8512:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787359868.214216:0:8512:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787359868.214221:0:8512:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787359868.215556:0:8513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787359868.215899:0:8512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787359868.219147:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787359868.219206:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787359868.219261:0:8512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787359868.219279:0:8512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787359868.219298:0:8512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219317:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219326:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219332:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219340:0:8512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219347:0:8512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219387:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359868.219404:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 9 pid: 5856 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359868.219430:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811456:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359868.223509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359868.223613:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910208 00000100:00100000:0.0:1787359868.223624:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910208 00010000:00010000:0.0:1787359868.223661:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 10 pid: 5856 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.223736:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:0.0:1787359868.223747:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508910208:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359868.223761:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359868.223769:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 10 pid: 5856 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359868.223792:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 10 pid: 5856 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359868.223812:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359868.223865:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508910208:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359868.223873:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00010000:00010000:0.0:1787359868.226267:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359868.226288:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 18 pid: 5856 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.226305:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40982680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811584:0@lo:104: 00000100:00100000:0.0:1787359868.226368:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359868.226431:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359868.226461:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 18 pid: 5853 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.226470:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811712:0@lo:104: 00000100:00100000:0.0:1787359868.226496:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787359868.226518:0:8512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359868.226537:0:8512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 18 pid: 5855 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.226544:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811840:0@lo:104: 00000100:00100000:0.0:1787359868.226562:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c480c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787359868.226589:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a400/0x72f6de40e4ef36d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3c6 expref: 9 pid: 5856 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.226604:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811456:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787359868.227109:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787359868.227133:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359868.227162:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811584 00000100:00100000:3.0:1787359868.227168:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811584 00000100:00100000:3.0:1787359868.227204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811712 00000100:00100000:3.0:1787359868.227207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811712 00000100:00100000:3.0:1787359868.227216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811840 00000100:00100000:3.0:1787359868.227219:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811840 00000100:00100000:3.0:1787359868.227231:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787359868.227240:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:8512:x1874182527811584:12345-0@lo:104: 00010000:00010000:3.0:1787359868.227253:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227308:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787359868.227314:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40982300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+5:8512:x1874182527811584:12345-0@lo:104: Request processed in 75us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359868.227321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787359868.227337:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787359868.227344:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:8512:x1874182527811712:12345-0@lo:104: 00010000:00010000:3.0:1787359868.227361:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227408:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787359868.227414:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f1fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+4:8512:x1874182527811712:12345-0@lo:104: Request processed in 71us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359868.227420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787359868.227453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787359868.227459:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:8512:x1874182527811840:12345-0@lo:104: 00010000:00010000:3.0:1787359868.227465:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227496:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787359868.227501:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6055641b-d743-4e3c-a711-70d92fdecc0d+3:8512:x1874182527811840:12345-0@lo:104: Request processed in 43us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359868.227506:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787359868.227531:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787359868.227536:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227543:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165ba00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359868.227547:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227556:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359868.227562:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359868.227574:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787359868.227603:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227610:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359868.227631:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227637:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165ba00/0x72f6de40e4ef3612 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3619 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227649:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787359868.227652:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227658:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00031800 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359868.227661:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227668:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359868.227697:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359868.227703:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787359868.227716:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227722:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359868.227734:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227741:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00031800/0x72f6de40e4ef3547 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef354e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227750:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787359868.227754:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227760:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00031a00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787359868.227762:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227768:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787359868.227775:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787359868.227905:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787359868.227919:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227925:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787359868.227940:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227946:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00031a00/0x72f6de40e4ef34e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef34ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.227957:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359868.227964:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359868.227966:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359868.227972:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359868.227977:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359868.227989:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527811968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787359868.228019:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359868.228052:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359868.228057:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527812096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787359868.228073:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359868.228097:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527812224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787359868.228117:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359868.228147:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527811968 00000100:00100000:3.0:1787359868.228151:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527811968 00010000:00010000:3.0:1787359868.228171:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 19 pid: 5856 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359868.228193:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812096 00000100:00100000:3.0:1787359868.228195:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812096 00010000:00010000:3.0:1787359868.228206:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 20 pid: 5853 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359868.228215:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812224 00000100:00100000:3.0:1787359868.228218:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812224 00010000:00010000:3.0:1787359868.228226:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 21 pid: 5855 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359868.228237:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359868.228243:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+21:3317:x1874182527811968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787359868.228253:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359868.228264:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 21 pid: 5856 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228274:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 21 pid: 5856 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228290:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359868.228318:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+21:3317:x1874182527811968:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359868.228325:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359868.228338:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787359868.228344:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3317:x1874182527812096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787359868.228353:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359868.228356:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 20 pid: 5853 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228363:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 20 pid: 5853 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228371:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359868.228513:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3619 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3612 expref: 20 pid: 5856 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.228534:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40982680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811584:0@lo:104: 00010000:00010000:0.0:1787359868.228545:0:8512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01484400/0x72f6de40e4ef354e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef3547 expref: 19 pid: 5853 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359868.228555:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811712:0@lo:104: 00000100:00100000:0.0:1787359868.228564:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8512:1874182527811840:0@lo:104: 00010000:00010000:0.0:1787359868.228589:0:8512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359868.228654:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+18:3317:x1874182527812096:12345-0@lo:103:ldlm_bl.0 Request processed in 309us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359868.228660:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787359868.228741:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787359868.228750:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3319:x1874182527812224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787359868.228759:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359868.228763:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 17 pid: 5855 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228909:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 17 pid: 5855 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228919:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01484a00/0x72f6de40e4ef34ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef34e5 expref: 17 pid: 5855 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228929:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228936:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228950:0:8457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228956:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228962:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228968:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228973:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787359868.228976:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.228982:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359868.232225:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527812096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359868.232239:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527811968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787359868.244036:0:8512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359868.244055:0:8512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.247553:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.247573:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3777 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359868.247593:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359868.247719:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527812224:12345-0@lo:103:ldlm_bl.0 Request processed in 18965us (19596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359868.247728:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787359868.247930:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527812224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787359868.970491:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787359869.351307:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787359869.351315:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d11588000 from 4 10000000:01000000:1.0:1787359869.351320:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359869.351383:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359869.351395:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359869.351407:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359869.351431:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.351498:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.351573:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48300 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.352199:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812352 00000100:00100000:2.0:1787359869.352207:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812352 00000100:00100000:2.0:1787359869.352270:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787359869.352279:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527812352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359869.352292:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359869.352307:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef377e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.352330:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.352357:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.353186:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676200, rc 0) 00000100:00100000:3.0:1787359869.354173:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527812352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1887us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359869.354185:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787359869.354494:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359869.354528:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359869.354541:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359869.354612:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.354646:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.354915:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359869.355035:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812480 00000100:00100000:3.0:1787359869.355041:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812480 00000100:00100000:3.0:1787359869.355087:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787359869.355095:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527812480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359869.355358:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527812480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359869.355375:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787359869.356578:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.356652:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.356866:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.356907:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359869.357144:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812608 00000100:00100000:3.0:1787359869.357150:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812608 00000100:00100000:3.0:1787359869.357248:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787359869.357258:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527812608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359869.357476:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527812608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359869.357492:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787359869.357579:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.359085:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8543:1874182527812736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359869.359155:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.359457:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359869.359743:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812736 00000100:00100000:0.0:1787359869.359751:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812736 00000100:00100000:0.0:1787359869.359803:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787359869.359811:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8543:x1874182527812736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359869.360040:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8543:x1874182527812736:12345-0@lo:502:llog_process_th.0 Request processed in 228us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359869.360047:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787359869.360348:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8543:1874182527812736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359869.360393:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359869.360404:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359869.360406:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787359869.360413:0:8543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d11588000 00000020:00000080:1.0:1787359869.360417:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787359869.360514:0:8543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8543:1874182527812864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359869.360557:0:8543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.360581:0:8543:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48180 going to sleep for 11 seconds 00000100:00100000:0.0:1787359869.363910:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812864 00000100:00100000:0.0:1787359869.363925:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812864 00000100:00100000:0.0:1787359869.364083:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787359869.364094:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8543:x1874182527812864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359869.364416:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:8543:x1874182527812864:12345-0@lo:502:llog_process_th.0 Request processed in 323us (3858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359869.364424:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787359869.364998:0:8543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8543:1874182527812864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359869.365037:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359869.365046:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359869.365049:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787359869.365054:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787359869.371901:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787359869.371933:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359869.371944:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.371957:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359869.371968:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787359869.371983:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d200eb000 from 4 10000000:01000000:2.0:1787359869.371985:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359869.372020:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.372027:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.372039:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359869.372062:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.372124:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.372174:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.372194:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527812992 00000100:00100000:2.0:1787359869.372200:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527812992 00000100:00100000:2.0:1787359869.372250:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787359869.372259:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527812992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359869.372272:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359869.372284:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef378c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.372305:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.372315:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.372324:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01677000, rc 0) 00000100:00100000:2.0:1787359869.372359:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527812992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.372379:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787359869.372425:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527812992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359869.372438:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.372447:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359869.372498:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.372534:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.372548:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.372559:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813120 00000100:00100000:2.0:1787359869.372563:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813120 00000100:00100000:2.0:1787359869.372593:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787359869.372599:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527813120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.372866:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527813120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.372873:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787359869.372918:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.372943:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.372978:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.372990:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.373001:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813248 00000100:00100000:2.0:1787359869.373004:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813248 00000100:00100000:2.0:1787359869.373023:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787359869.373029:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527813248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.373161:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527813248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.373168:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787359869.373202:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.373370:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8546:1874182527813376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359869.373401:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.373419:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813376 00000100:00100000:2.0:1787359869.373423:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813376 00000100:00100000:2.0:1787359869.373442:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787359869.373448:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8546:x1874182527813376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359869.373586:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8546:x1874182527813376:12345-0@lo:502:llog_process_th.0 Request processed in 137us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.373599:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787359869.373628:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.373639:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8546:1874182527813376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359869.373658:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359869.373667:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359869.373669:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787359869.373697:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d200eb000 00000020:00000080:2.0:1787359869.373700:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787359869.373778:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8546:1874182527813504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359869.373810:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.373828:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813504 00000100:00100000:2.0:1787359869.373831:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813504 00000100:00100000:2.0:1787359869.373850:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787359869.373856:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8546:x1874182527813504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359869.373952:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:8546:x1874182527813504:12345-0@lo:502:llog_process_th.0 Request processed in 95us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.373959:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787359869.373985:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.373996:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8546:1874182527813504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359869.374011:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787359869.374016:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359869.374018:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787359869.374021:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787359869.374070:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787359869.374083:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359869.374091:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374106:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787359869.374115:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787359869.374117:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d0dccf000 from 4 10000000:01000000:2.0:1787359869.374119:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359869.374138:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374146:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374154:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359869.374167:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.374190:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.374202:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.374213:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813632 00000100:00100000:2.0:1787359869.374216:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813632 00000100:00100000:2.0:1787359869.374237:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787359869.374242:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527813632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359869.374248:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359869.374257:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef379a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374275:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374295:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374303:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d01676000, rc 0) 00000100:00100000:2.0:1787359869.374330:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527813632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.374335:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787359869.374361:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359869.374371:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.374378:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359869.374414:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.374436:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.374448:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.374458:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813760 00000100:00100000:2.0:1787359869.374460:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813760 00000100:00100000:2.0:1787359869.374479:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787359869.374484:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527813760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.374672:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527813760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.374702:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787359869.374730:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.374758:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.374785:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359869.374797:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.374806:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527813888 00000100:00100000:2.0:1787359869.374809:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527813888 00000100:00100000:2.0:1787359869.374825:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787359869.374829:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527813888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.374922:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527813888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.374928:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787359869.374961:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527813888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.387394:0:8547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8547:1874182527814016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359869.387487:0:8547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.387543:0:8547:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.387656:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814016 00000100:00100000:2.0:1787359869.387664:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814016 00000100:00100000:2.0:1787359869.387737:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787359869.387747:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:8547:x1874182527814016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359869.387981:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:8547:x1874182527814016:12345-0@lo:502:llog_process_th.0 Request processed in 223us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.387990:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787359869.388277:0:8547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8547:1874182527814016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359869.388315:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787359869.388324:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359869.388326:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787359869.388331:0:8547:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d0dccf000 00000020:00000080:1.0:1787359869.388333:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787359869.388424:0:8547:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8547:1874182527814144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359869.388460:0:8547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359869.388474:0:8547:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359869.388596:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814144 00000100:00100000:2.0:1787359869.388601:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814144 00000100:00100000:2.0:1787359869.388635:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787359869.388643:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:8547:x1874182527814144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359869.388803:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:8547:x1874182527814144:12345-0@lo:502:llog_process_th.0 Request processed in 159us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.388810:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787359869.389957:0:8547:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:8547:1874182527814144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787359869.390007:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787359869.390016:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787359869.390019:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787359869.390023:0:8547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787359869.393178:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787359869.393218:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787359869.393228:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359869.393240:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359869.969592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359869.969633:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910336 00000100:00100000:1.0:1787359869.969645:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910336 00000100:00100000:1.0:1787359869.969712:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 186 00000100:00100000:1.0:1787359869.969721:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+9:5603:x1874182508910336:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359869.969740:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359869.970450:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce405 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359869.970484:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359869.970506:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359869.970539:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165ba00, rc 0) 00000100:00100000:1.0:1787359869.970608:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508910336:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 887us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359869.970616:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 186 00000100:00100000:1.0:1787359869.975364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359869.975437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910464 00000100:00100000:2.0:1787359869.975448:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910464 00000100:00100000:2.0:1787359869.975516:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 187 00000100:00100000:2.0:1787359869.975527:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508910464:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359869.975819:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508910464:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 293us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359869.975828:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 187 00000100:00100000:0.0:1787359869.980484:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359869.980598:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910592 00000100:00100000:1.0:1787359869.980609:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910592 00000100:00100000:1.0:1787359869.980666:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 188 00000100:00100000:1.0:1787359869.980699:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508910592:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359869.980927:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:5603:x1874182508910592:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 251us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359869.980935:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 188 00000100:00100000:2.0:1787359869.989034:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359869.989152:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910720 00000100:00100000:3.0:1787359869.989161:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910720 00000100:00100000:3.0:1787359869.989207:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 189 00000100:00100000:3.0:1787359869.989216:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:6134:x1874182508910720:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787359869.989438:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:6134:x1874182508910720:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 221us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359869.989446:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 189 00010000:00010000:0.0:1787359869.998662:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359870.005770:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359870.005839:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910848 00000100:00100000:1.0:1787359870.005848:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910848 00000100:00100000:1.0:1787359870.005905:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 190 00000100:00100000:1.0:1787359870.005914:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:6134:x1874182508910848:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787359870.006147:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:6134:x1874182508910848:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 233us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359870.006156:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 190 00000100:00100000:3.0:1787359870.377812:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527814272:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.377888:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359870.377938:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527814784:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.377965:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359870.377993:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787359870.377999:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527814656:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378025:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359870.378055:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527814400:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378077:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359870.378093:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527814912:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378112:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359870.378128:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359870.378134:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527814528:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378155:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359870.378187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814272 00000100:00100000:3.0:1787359870.378195:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814272 00000100:00100000:3.0:1787359870.378253:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787359870.378262:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527814272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378310:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527814272:12345-0@lo:400:kworker.0 Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.378317:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787359870.378365:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814784 00000100:00100000:3.0:1787359870.378369:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814784 00000100:00100000:3.0:1787359870.378398:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814400 00000100:00100000:3.0:1787359870.378400:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814400 00000100:00100000:3.0:1787359870.378410:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814528 00000100:00100000:3.0:1787359870.378412:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814528 00000100:00100000:3.0:1787359870.378425:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787359870.378431:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527814784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378461:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527814784:12345-0@lo:400:kworker.0 Request processed in 30us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.378467:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787359870.378478:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359870.378495:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527814400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378525:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527814400:12345-0@lo:400:kworker.0 Request processed in 42us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.378531:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359870.378543:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359870.378548:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527814528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378572:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527814528:12345-0@lo:400:kworker.0 Request processed in 23us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.378578:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359870.378593:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814656 00000100:00100000:3.0:1787359870.378603:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814656 00000100:00100000:3.0:1787359870.378629:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527814912 00000100:00100000:3.0:1787359870.378631:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527814912 00000100:00100000:3.0:1787359870.378645:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359870.378651:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527814656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378708:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527814656:12345-0@lo:400:kworker.0 Request processed in 57us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.378714:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787359870.378725:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359870.378731:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527814912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378757:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527814912:12345-0@lo:400:kworker.0 Request processed in 26us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.378763:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787359870.378803:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b8a80 x1874182527814656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359870.378819:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527814656:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378830:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527814272:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378839:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527814784:0@lo:400:kworker.0 00000100:00080000:3.0:1787359870.378863:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359870.378867:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787359870.378870:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359870.378882:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527814528:0@lo:400:kworker.0 00000100:00100000:3.0:1787359870.378891:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527814400:0@lo:400:kworker.0 00010000:00080000:3.0:1787359870.378900:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9f80 x1874182527814912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359870.378921:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527814912:0@lo:400:kworker.0 00000100:00100000:1.0:1787359870.888011:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359870.888048:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527815040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359870.888170:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359870.888959:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815040 00000100:00100000:2.0:1787359870.888972:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815040 00000100:00100000:3.0:1787359870.889109:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787359870.889129:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527815040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787359870.889199:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359870.891719:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527815040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2587us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359870.891743:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787359870.896636:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40981f80 x1874182527815040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359870.896711:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527815040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359871.014934:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359872.038890:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359872.092774:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359872.092820:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359872.092854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359872.092880:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359872.092920:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911360 00000100:00100000:2.0:1787359872.097747:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911360 00000100:00100000:2.0:1787359872.097859:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911232 00000100:00100000:2.0:1787359872.097864:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911232 00000100:00100000:2.0:1787359872.097891:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787359872.097904:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508911360:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359872.098047:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508911360:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 146us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359872.098057:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787359872.098207:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911104 00000100:00100000:1.0:1787359872.098212:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911104 00000100:00100000:1.0:1787359872.098254:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:1.0:1787359872.098262:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508911104:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359872.098297:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508911104:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 37us (5540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359872.098305:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:1.0:1787359872.098349:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508910976 00000100:00100000:1.0:1787359872.098353:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508910976 00000100:00100000:1.0:1787359872.098381:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 192 00000100:00100000:1.0:1787359872.098388:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:2364:x1874182508910976:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359872.098414:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:2364:x1874182508910976:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 27us (5559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359872.098420:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 192 00000100:00100000:1.0:1787359872.098722:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:1.0:1787359872.098732:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508911232:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359872.098764:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508911232:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 34us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359872.098771:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00080000:2.0:1787359872.101533:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359872.101546:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787359872.101550:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787359872.937908:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527815168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359872.938016:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359872.938246:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815168 00000100:00100000:3.0:1787359872.938257:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815168 00000100:00100000:3.0:1787359872.938331:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787359872.938341:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527815168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787359872.938384:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359872.938436:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527815168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359872.938456:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787359872.938502:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9f80 x1874182527815168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359872.938522:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527815168:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787359872.939760:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359873.068122:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359874.092293:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359875.113594:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787359875.356772:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787359875.496139:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527815552:0@lo:400:kworker.0 00000100:00100000:2.0:1787359875.496214:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359875.496279:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787359875.496286:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527815424:0@lo:400:kworker.0 00000100:00100000:2.0:1787359875.496310:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359875.496325:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527815936:0@lo:400:kworker.0 00000100:00100000:2.0:1787359875.496353:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359875.496392:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815552 00000100:00100000:2.0:1787359875.496410:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815552 00000100:00100000:2.0:1787359875.496459:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815424 00000100:00100000:2.0:1787359875.496463:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815424 00000100:00100000:2.0:1787359875.496481:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787359875.496488:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527815552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359875.496540:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527815552:12345-0@lo:400:kworker.0 Request processed in 52us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359875.496548:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787359875.496580:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359875.496588:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359875.496616:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527815424:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359875.496632:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359875.496670:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527815424:0@lo:400:kworker.0 00000100:00100000:2.0:1787359875.496716:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527815552:0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.496802:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527815680:0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.496834:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359875.496865:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787359875.496872:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527815296:0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.496901:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359875.496921:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527815808:0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.496942:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359875.496972:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815808 00000100:00100000:1.0:1787359875.496976:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815808 00000100:00100000:1.0:1787359875.497002:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787359875.497008:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527815808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.497044:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527815808:12345-0@lo:400:kworker.0 Request processed in 36us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359875.497050:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787359875.497076:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815936 00000100:00100000:1.0:1787359875.497080:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815936 00000100:00100000:1.0:1787359875.497106:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815680 00000100:00100000:1.0:1787359875.497109:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815680 00000100:00100000:1.0:1787359875.497124:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359875.497131:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527815936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.497168:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527815936:12345-0@lo:400:kworker.0 Request processed in 37us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359875.497173:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787359875.497186:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787359875.497192:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527815680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359875.497229:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527815680:12345-0@lo:400:kworker.0 Request processed in 37us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359875.497235:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787359875.497251:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359875.497254:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359875.497257:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359875.497282:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527815808:0@lo:400:kworker.0 00010000:00080000:1.0:1787359875.497293:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40987480 x1874182527815680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359875.497304:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527815680:0@lo:400:kworker.0 00010000:00080000:1.0:1787359875.497332:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40987800 x1874182527815936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359875.497340:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527815936:0@lo:400:kworker.0 00000100:00100000:3.0:1787359875.497534:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527815296 00000100:00100000:3.0:1787359875.497539:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527815296 00000100:00100000:3.0:1787359875.497584:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787359875.497593:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527815296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359875.497648:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527815296:12345-0@lo:400:kworker.0 Request processed in 57us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359875.497655:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787359875.497792:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527815296:0@lo:400:kworker.0 00000100:00100000:1.0:1787359876.015584:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527816064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359876.015660:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359876.024280:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816064 00000100:00100000:3.0:1787359876.024294:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816064 00000100:00100000:2.0:1787359876.027758:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787359876.027774:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527816064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359876.027820:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359876.027914:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527816064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (12252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359876.027920:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787359876.027964:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40983800 x1874182527816064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359876.027984:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527816064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787359876.141288:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359877.158851:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359877.199166:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359877.199219:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359877.199264:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359877.199295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359877.199338:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911616 00000100:00100000:2.0:1787359877.199351:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911616 00000100:00100000:2.0:1787359877.199439:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:2.0:1787359877.199453:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508911616:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359877.199700:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911744 00000100:00100000:0.0:1787359877.199724:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911744 00000100:00100000:0.0:1787359877.199759:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911872 00000100:00100000:0.0:1787359877.199762:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911872 00000100:00100000:0.0:1787359877.199782:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:0.0:1787359877.199790:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508911744:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359877.199878:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508911744:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 88us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359877.199887:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:0.0:1787359877.199907:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:0.0:1787359877.199913:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508911872:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359877.199939:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508911872:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359877.199945:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00080000:0.0:1787359877.200397:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787359877.200403:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787359877.200406:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359877.200864:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508911616:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 1411us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359877.200891:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:3.0:1787359877.201271:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508911488 00000100:00100000:3.0:1787359877.201281:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508911488 00000100:00100000:3.0:1787359877.201400:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 194 00000100:00100000:3.0:1787359877.201410:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508911488:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359877.201457:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508911488:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 49us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359877.201464:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 194 00000100:00100000:3.0:1787359878.054986:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527816192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359878.055085:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359878.055188:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816192 00000100:00100000:3.0:1787359878.055197:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816192 00000100:00100000:3.0:1787359878.055517:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787359878.055530:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527816192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787359878.055588:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359878.055646:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527816192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359878.055654:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787359878.057045:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9f80 x1874182527816192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359878.057080:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527816192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787359878.062407:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359878.189371:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359879.207854:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359880.241798:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787359880.606742:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing yml_node 00000100:00100000:3.0:1787359880.616160:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527816704:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616264:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359880.616346:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787359880.616353:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527816320:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616384:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359880.616410:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527816832:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616434:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359880.616458:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527816448:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616480:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359880.616496:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527816960:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616513:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359880.616529:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359880.616533:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527816576:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616551:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359880.616583:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816704 00000100:00100000:3.0:1787359880.616592:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816704 00000100:00100000:3.0:1787359880.616647:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816960 00000100:00100000:3.0:1787359880.616650:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816960 00000100:00100000:3.0:1787359880.616668:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359880.616695:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527816704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616753:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527816704:12345-0@lo:400:kworker.0 Request processed in 77us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359880.616761:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359880.616779:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787359880.616791:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527816960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616821:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527816960:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359880.616826:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787359880.616844:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816832 00000100:00100000:3.0:1787359880.616848:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816832 00000100:00100000:3.0:1787359880.616867:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816448 00000100:00100000:3.0:1787359880.616870:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816448 00000100:00100000:3.0:1787359880.616879:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816576 00000100:00100000:3.0:1787359880.616880:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816576 00000100:00100000:3.0:1787359880.616892:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787359880.616897:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527816832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616922:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527816832:12345-0@lo:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359880.616928:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787359880.616938:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359880.616942:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527816448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.616966:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527816448:12345-0@lo:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359880.616971:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787359880.616980:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787359880.616986:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527816576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.617008:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527816576:12345-0@lo:400:kworker.0 Request processed in 23us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359880.617013:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787359880.617036:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787359880.617042:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359880.617049:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359880.617088:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527816576:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.617099:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527816448:0@lo:400:kworker.0 00010000:00080000:3.0:1787359880.617110:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ce00 x1874182527816960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359880.617121:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527816960:0@lo:400:kworker.0 00000100:00100000:3.0:1787359880.617151:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527816832:0@lo:400:kworker.0 00010000:00080000:3.0:1787359880.617160:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9500 x1874182527816704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359880.617169:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527816704:0@lo:400:kworker.0 00000100:00100000:1.0:1787359880.617268:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527816320 00000100:00100000:1.0:1787359880.617273:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527816320 00000100:00100000:1.0:1787359880.617388:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787359880.617396:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527816320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359880.617440:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527816320:12345-0@lo:400:kworker.0 Request processed in 45us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359880.617447:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787359880.617485:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527816320:0@lo:400:kworker.0 00000100:00100000:0.0:1787359881.130598:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359881.130626:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527817088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359881.130742:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359881.130824:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817088 00000100:00100000:0.0:1787359881.130835:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817088 00000100:00100000:0.0:1787359881.130891:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787359881.130902:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527817088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787359881.130959:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359881.131021:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527817088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359881.131103:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787359881.131156:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40982680 x1874182527817088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359881.131193:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40982680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527817088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359881.256396:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359882.279318:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359882.323649:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359882.323719:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359882.323885:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912128 00000100:00100000:3.0:1787359882.323895:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912128 00000100:00100000:3.0:1787359882.323983:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:3.0:1787359882.323994:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508912128:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359882.324074:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508912128:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359882.324081:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00080000:0.0:1787359882.324246:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359882.326887:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912000 00000100:00100000:2.0:1787359882.326915:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912000 00000100:00100000:2.0:1787359882.327005:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 196 00000100:00100000:2.0:1787359882.327020:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508912000:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359882.327140:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508912000:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 115us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359882.327150:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 196 00000100:00100000:0.0:1787359882.328512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359882.328560:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359882.328648:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912256 00000100:00100000:1.0:1787359882.328709:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912256 00000100:00100000:1.0:1787359882.328768:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912384 00000100:00100000:1.0:1787359882.328772:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912384 00000100:00100000:1.0:1787359882.328791:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:1.0:1787359882.328802:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2361:x1874182508912256:12345-192.168.201.14@tcp:9:kworker.0 00000020:00000080:1.0:1787359882.328839:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef36e4 00000100:00080000:1.0:1787359882.328851:0:6701:0:(import.c:65:import_set_state_nolock()) ffff983d27d82000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787359882.328888:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787359882.329233:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+2:2361:x1874182508912256:12345-192.168.201.14@tcp:9:kworker.0 Request processed in 431us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359882.329242:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:1.0:1787359882.329260:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:1.0:1787359882.329268:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2361:x1874182508912384:12345-192.168.201.14@tcp:9:kworker.0 00000020:00000080:1.0:1787359882.329293:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef36eb 00000100:00080000:1.0:1787359882.329300:0:6701:0:(import.c:65:import_set_state_nolock()) ffff983d27d84000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787359882.329319:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787359882.329523:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+2:2361:x1874182508912384:12345-192.168.201.14@tcp:9:kworker.0 Request processed in 255us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359882.329530:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00080000:0.0:1787359882.329723:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787359882.329727:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359882.330433:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359882.330440:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359883.176820:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527817216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359883.176895:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359883.177156:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817216 00000100:00100000:0.0:1787359883.177165:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817216 00000100:00100000:0.0:1787359883.177238:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787359883.177247:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527817216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359883.177303:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787359883.177372:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359883.178331:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527817216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1080us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359883.178343:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787359883.179394:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ce00 x1874182527817216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359883.179421:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527817216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787359883.303033:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787359884.147844:0:9249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.45 00010000:00010000:3.0:1787359884.330574:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359885.354830:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359885.735596:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527817600:0@lo:400:kworker.0 00000100:00100000:1.0:1787359885.735701:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359885.735767:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787359885.735774:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527817472:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736004:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527817344:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736050:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359885.736079:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527817856:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736107:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359885.736126:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787359885.736132:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527817728:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736155:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359885.736187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817344 00000100:00100000:3.0:1787359885.736194:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817344 00000100:00100000:3.0:1787359885.736252:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787359885.736261:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527817344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736309:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527817344:12345-0@lo:400:kworker.0 Request processed in 48us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359885.736316:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787359885.736348:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817600 00000100:00100000:3.0:1787359885.736352:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817600 00000100:00100000:3.0:1787359885.736382:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817856 00000100:00100000:3.0:1787359885.736385:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817856 00000100:00100000:3.0:1787359885.736402:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787359885.736407:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527817600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736438:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527817600:12345-0@lo:400:kworker.0 Request processed in 31us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359885.736444:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787359885.736456:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787359885.736462:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527817856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736499:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527817856:12345-0@lo:400:kworker.0 Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359885.736514:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787359885.736535:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359885.736565:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527817344:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736578:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527817856:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736636:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817728 00000100:00100000:3.0:1787359885.736640:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817728 00000100:00100000:3.0:1787359885.736670:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787359885.736701:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527817728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.736736:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527817728:12345-0@lo:400:kworker.0 Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359885.736742:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787359885.736758:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787359885.736777:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03f480 x1874182527817728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359885.736799:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527817728:0@lo:400:kworker.0 00000100:00100000:1.0:1787359885.737179:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359885.737211:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527817984:0@lo:400:kworker.0 00000100:00100000:1.0:1787359885.737249:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359885.737273:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527817600:0@lo:400:kworker.0 00000100:00100000:2.0:1787359885.737910:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817984 00000100:00100000:2.0:1787359885.737917:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817984 00000100:00080000:0.0:1787359885.738048:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359885.738101:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359885.738111:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527817984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359885.738171:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527817984:12345-0@lo:400:kworker.0 Request processed in 63us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359885.738178:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787359885.738257:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03d880 x1874182527817984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359885.738267:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527817984:0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.738356:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527817472 00000100:00100000:3.0:1787359885.738360:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527817472 00000100:00100000:3.0:1787359885.738393:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359885.738400:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527817472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359885.738492:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527817472:12345-0@lo:400:kworker.0 Request processed in 92us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359885.738499:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787359885.739204:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527817472:0@lo:400:kworker.0 00000100:00100000:0.0:1787359886.248592:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527818112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359886.248700:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359886.248832:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818112 00000100:00100000:3.0:1787359886.248841:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818112 00000100:00100000:3.0:1787359886.248897:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787359886.248918:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527818112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787359886.248966:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359886.249015:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527818112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359886.249022:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787359886.249163:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369e680 x1874182527818112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359886.249185:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527818112:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787359886.310518:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:1.0:1787359886.310530:0:6724:0:(genops.c:885:class_export_put()) final put ffff983d27d81000/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:3.0:1787359886.310670:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff983d27d81000/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 for lustre-OST0000 00000020:00000080:3.0:1787359886.310801:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d27d82000 for lustre-OST0000 00010000:00010000:0.0:1787359886.375917:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787359886.843509:0:9350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.45 00000001:00100000:1.0:1787359886.848768:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:1.0:1787359886.848777:0:7649:0:(genops.c:885:class_export_put()) final put ffff983d27d86800/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:1.0:1787359886.848813:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d27d86800/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 for lustre-OST0001 00000020:00000080:1.0:1787359886.848865:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d27d84000 for lustre-OST0001 00010000:00010000:0.0:1787359887.399406:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359887.442847:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359887.442916:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359887.442996:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912640 00000100:00100000:3.0:1787359887.443006:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912640 00000100:00100000:3.0:1787359887.443087:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:3.0:1787359887.443098:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508912640:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359887.443198:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508912640:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359887.443206:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00080000:0.0:1787359887.443620:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359887.443916:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912512 00000100:00100000:2.0:1787359887.443922:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912512 00000100:00100000:2.0:1787359887.443951:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 198 00000100:00100000:2.0:1787359887.443958:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2362:x1874182508912512:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359887.444012:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2362:x1874182508912512:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 54us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359887.444019:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 198 00000100:00100000:1.0:1787359888.296430:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359888.296465:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527818240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359888.296539:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359888.296812:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818240 00000100:00100000:3.0:1787359888.296820:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818240 00000100:00100000:3.0:1787359888.296894:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787359888.296905:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527818240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787359888.296940:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359888.296992:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527818240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359888.296999:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1787359888.297037:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369df80 x1874182527818240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359888.297069:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527818240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787359888.297327:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359888.422951:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359889.309851:0:9447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.45 00010000:00010000:0.0:1787359889.447042:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359890.485086:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787359890.828747:0:9495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 20:51:28 EDT 2026 00000100:00100000:3.0:1787359890.856302:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527818496:0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856379:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359890.856430:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527819008:0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856457:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359890.856487:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359890.856493:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527818624:0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856515:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359890.856549:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818496 00000100:00100000:3.0:1787359890.856557:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818496 00000100:00100000:3.0:1787359890.856598:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818624 00000100:00100000:3.0:1787359890.856601:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818624 00000100:00100000:3.0:1787359890.856627:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787359890.856635:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527818496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856708:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527818496:12345-0@lo:400:kworker.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359890.856716:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787359890.856733:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787359890.856739:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527818624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856764:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527818624:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359890.856769:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787359890.856786:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819008 00000100:00100000:3.0:1787359890.856790:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819008 00000100:00100000:3.0:1787359890.856815:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787359890.856820:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527819008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856859:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527819008:12345-0@lo:400:kworker.0 Request processed in 39us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359890.856865:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787359890.856886:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359890.856891:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359890.856920:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527818624:0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.856929:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527818496:0@lo:400:kworker.0 00010000:00080000:3.0:1787359890.856939:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369c000 x1874182527819008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359890.856949:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527819008:0@lo:400:kworker.0 00000100:00100000:0.0:1787359890.857177:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527818368:0@lo:400:kworker.0 00000100:00100000:0.0:1787359890.857211:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359890.857247:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527818880:0@lo:400:kworker.0 00000100:00100000:0.0:1787359890.857269:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359890.857285:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359890.857290:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527818752:0@lo:400:kworker.0 00000100:00100000:0.0:1787359890.857311:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359890.857347:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818752 00000100:00100000:0.0:1787359890.857351:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818752 00000100:00100000:0.0:1787359890.857380:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787359890.857386:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527818752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359890.857422:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527818752:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359890.857436:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787359890.857463:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ea00 x1874182527818752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359890.857473:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527818752:0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.857948:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818368 00000100:00100000:3.0:1787359890.857953:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818368 00000100:00100000:3.0:1787359890.857985:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787359890.857992:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527818368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.858044:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527818368:12345-0@lo:400:kworker.0 Request processed in 53us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359890.858051:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1787359890.858078:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359890.858097:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527818368:0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.858116:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527818880 00000100:00100000:3.0:1787359890.858120:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527818880 00000100:00100000:3.0:1787359890.858164:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787359890.858172:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527818880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359890.858206:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527818880:12345-0@lo:400:kworker.0 Request processed in 35us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359890.858220:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787359890.858236:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359890.858253:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527818880:0@lo:400:kworker.0 00000100:00100000:3.0:1787359891.367131:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359891.367157:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527819136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359891.367237:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359891.367411:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819136 00000100:00100000:2.0:1787359891.367437:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819136 00000100:00100000:2.0:1787359891.367498:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787359891.367508:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527819136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359891.367543:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359891.367592:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527819136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359891.367600:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787359891.367643:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369fb80 x1874182527819136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359891.367664:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527819136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359891.494956:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359892.520252:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359892.553776:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359892.553829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359892.553861:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912768 00000100:00100000:0.0:1787359892.553873:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912768 00000100:00100000:0.0:1787359892.553925:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 200 00000100:00100000:0.0:1787359892.553935:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:2364:x1874182508912768:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359892.554006:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+10:2364:x1874182508912768:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359892.554014:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 200 00000100:00100000:2.0:1787359892.554096:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508912896 00000100:00100000:2.0:1787359892.554101:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508912896 00000100:00100000:2.0:1787359892.554158:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:2.0:1787359892.554165:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508912896:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359892.554195:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508912896:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359892.554201:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00080000:0.0:1787359892.554774:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359893.419852:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527819264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359893.419924:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359893.423786:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819264 00000100:00100000:2.0:1787359893.423800:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819264 00000100:00100000:2.0:1787359893.423879:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787359893.423891:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527819264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359893.423925:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359893.424006:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527819264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359893.424013:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787359893.424058:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40984700 x1874182527819264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359893.424077:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527819264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787359893.424194:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359893.547433:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359894.568453:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359895.591717:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359895.985382:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527819776:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.985460:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359895.985524:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787359895.985531:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527819392:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.985558:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359895.985583:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527819904:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.985607:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359895.985631:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527819520:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.985670:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359895.985709:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527820032:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.985730:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359895.985749:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359895.985755:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527819648:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.985774:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359895.985805:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819776 00000100:00100000:1.0:1787359895.985812:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819776 00000100:00100000:1.0:1787359895.985859:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820032 00000100:00100000:1.0:1787359895.986013:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820032 00000100:00100000:1.0:1787359895.986040:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359895.986059:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527819776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986113:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527819776:12345-0@lo:400:kworker.0 Request processed in 65us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359895.986119:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359895.986136:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787359895.986142:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527820032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986174:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527820032:12345-0@lo:400:kworker.0 Request processed in 32us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359895.986179:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787359895.986197:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819392 00000100:00100000:1.0:1787359895.986200:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819392 00000100:00100000:1.0:1787359895.986224:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787359895.986230:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527819392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986260:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527819392:12345-0@lo:400:kworker.0 Request processed in 30us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359895.986275:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787359895.986302:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819904 00000100:00100000:1.0:1787359895.986306:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819904 00000100:00100000:1.0:1787359895.986325:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819520 00000100:00100000:1.0:1787359895.986327:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819520 00000100:00100000:1.0:1787359895.986337:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527819648 00000100:00100000:1.0:1787359895.986340:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527819648 00000100:00100000:1.0:1787359895.986355:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787359895.986361:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527819904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986393:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527819904:12345-0@lo:400:kworker.0 Request processed in 32us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359895.986399:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787359895.986411:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787359895.986416:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527819520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986441:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527819520:12345-0@lo:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359895.986448:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787359895.986458:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787359895.986464:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527819648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986493:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527819648:12345-0@lo:400:kworker.0 Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359895.986498:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787359895.986518:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787359895.986522:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359895.986524:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359895.986548:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527819392:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986572:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527819904:0@lo:400:kworker.0 00010000:00080000:1.0:1787359895.986584:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03f480 x1874182527819776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359895.986595:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527819776:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986625:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527819648:0@lo:400:kworker.0 00000100:00100000:1.0:1787359895.986634:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527819520:0@lo:400:kworker.0 00010000:00080000:1.0:1787359895.986643:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03d500 x1874182527820032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359895.986652:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527820032:0@lo:400:kworker.0 00000100:00100000:1.0:1787359896.490829:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527820160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359896.490903:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359896.491392:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820160 00000100:00100000:2.0:1787359896.491409:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820160 00000100:00100000:2.0:1787359896.491455:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787359896.491464:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527820160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359896.491498:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359896.491553:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527820160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359896.491560:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787359896.491617:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03d500 x1874182527820160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359896.491636:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527820160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787359896.615389:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359897.648553:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359897.674106:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359897.674163:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359897.674172:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913152 00000100:00100000:2.0:1787359897.674183:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913152 00000100:00100000:2.0:1787359897.674258:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:2.0:1787359897.674270:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508913152:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359897.674320:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913024 00000100:00100000:3.0:1787359897.674325:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913024 00000100:00100000:2.0:1787359897.674346:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508913152:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 78us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359897.674350:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 202 00000100:00100000:2.0:1787359897.674354:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:3.0:1787359897.674356:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508913024:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359897.674395:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+10:2363:x1874182508913024:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359897.674402:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 202 00000100:00080000:1.0:1787359897.675446:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359898.534833:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527820288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359898.535066:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359898.535326:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820288 00000100:00100000:2.0:1787359898.535335:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820288 00000100:00100000:2.0:1787359898.535427:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787359898.535438:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527820288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359898.535473:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359898.535537:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527820288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359898.535544:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787359898.535619:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787359898.535765:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40984700 x1874182527820288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359898.535784:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527820288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787359898.667295:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359899.693401:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359900.714071:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359901.108242:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527820416:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108329:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359901.108377:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527820928:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108401:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359901.108424:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787359901.108589:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527820800:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108618:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359901.108647:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527820544:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108671:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359901.108715:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527821056:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108736:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359901.108756:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359901.108761:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527820672:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108795:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359901.108831:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820416 00000100:00100000:3.0:1787359901.108838:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820416 00000100:00100000:3.0:1787359901.108879:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787359901.108888:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527820416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.108934:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527820416:12345-0@lo:400:kworker.0 Request processed in 47us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359901.108941:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787359901.108985:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820928 00000100:00100000:3.0:1787359901.108989:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820928 00000100:00100000:3.0:1787359901.109017:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820544 00000100:00100000:3.0:1787359901.109032:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820544 00000100:00100000:3.0:1787359901.109045:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820672 00000100:00100000:3.0:1787359901.109047:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820672 00000100:00100000:3.0:1787359901.109062:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787359901.109074:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527820928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.109108:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527820928:12345-0@lo:400:kworker.0 Request processed in 34us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359901.109114:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787359901.109126:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787359901.109514:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527820544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.109553:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527820544:12345-0@lo:400:kworker.0 Request processed in 41us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359901.109559:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787359901.109573:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787359901.109579:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527820672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.109607:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527820672:12345-0@lo:400:kworker.0 Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359901.109613:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787359901.109630:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527820800 00000100:00100000:3.0:1787359901.109635:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527820800 00000100:00100000:3.0:1787359901.109659:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821056 00000100:00100000:3.0:1787359901.109662:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821056 00000100:00080000:1.0:1787359901.109910:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359901.109914:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359901.109916:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359901.111801:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787359901.111825:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527820800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.111900:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527820800:12345-0@lo:400:kworker.0 Request processed in 87us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359901.116865:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787359901.116894:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527821056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359901.117000:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527821056:12345-0@lo:400:kworker.0 Request processed in 121us (8262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359901.117009:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787359901.117460:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527820672:0@lo:400:kworker.0 00000100:00100000:2.0:1787359901.117477:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527820544:0@lo:400:kworker.0 00010000:00080000:2.0:1787359901.117491:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d409b9f80 x1874182527821056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359901.117502:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527821056:0@lo:400:kworker.0 00010000:00080000:2.0:1787359901.117936:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369e680 x1874182527820800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359901.117947:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527820800:0@lo:400:kworker.0 00000100:00100000:2.0:1787359901.117970:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527820416:0@lo:400:kworker.0 00000100:00100000:2.0:1787359901.117987:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527820928:0@lo:400:kworker.0 00000100:00100000:3.0:1787359901.123358:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359901.614852:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359901.614883:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527821184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359901.614983:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359901.615147:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821184 00000100:00100000:1.0:1787359901.615160:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821184 00000100:00100000:1.0:1787359901.615215:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359901.615225:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527821184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359901.615263:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359901.615314:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527821184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359901.615321:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787359901.618616:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03f480 x1874182527821184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359901.618641:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527821184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787359901.736904:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359902.760055:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359902.796524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359902.796579:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359902.796721:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913280 00000100:00100000:3.0:1787359902.796731:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913280 00000100:00100000:3.0:1787359902.796778:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 204 00000100:00100000:3.0:1787359902.796787:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508913280:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359902.796884:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182508913280:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359902.796893:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 204 00000100:00100000:3.0:1787359902.796938:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913408 00000100:00100000:3.0:1787359902.796942:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913408 00000100:00100000:3.0:1787359902.796992:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 55 00000100:00100000:3.0:1787359902.796999:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508913408:12345-192.168.201.14@tcp:400:kworker.0 00000100:00080000:2.0:1787359902.796999:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359902.797035:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508913408:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359902.797042:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 55 00000100:00100000:3.0:1787359903.655386:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527821312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359903.655459:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359903.655906:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821312 00000100:00100000:1.0:1787359903.655922:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821312 00000100:00100000:1.0:1787359903.656281:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787359903.656295:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527821312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787359903.656332:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359903.656386:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527821312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359903.656393:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787359903.656539:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787359903.656568:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e242a00 x1874182527821312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359903.656587:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527821312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787359903.790533:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359904.806985:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359905.846982:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359906.215996:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527821824:0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.216094:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359906.216176:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787359906.216183:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527821440:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.216868:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527821696:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.223443:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359906.223530:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787359906.223546:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527821568:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.223586:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359906.223757:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821696 00000100:00100000:0.0:1787359906.223768:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821696 00000100:00100000:0.0:1787359906.223835:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821568 00000100:00100000:0.0:1787359906.223838:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821568 00000100:00100000:0.0:1787359906.223858:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787359906.223868:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527821696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.226312:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527822080:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.226404:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359906.226499:0:5862:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787359906.226511:0:5862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787359906.227750:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359906.227823:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821824 00000100:00100000:2.0:1787359906.227834:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821824 00000100:00100000:2.0:1787359906.227914:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822080 00000100:00100000:2.0:1787359906.227926:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822080 00000100:00100000:2.0:1787359906.227954:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787359906.227966:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527821824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.228050:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527821824:12345-0@lo:400:kworker.0 Request processed in 87us (11956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359906.228058:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787359906.228079:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359906.228098:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527822080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.228135:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527822080:12345-0@lo:400:kworker.0 Request processed in 38us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359906.228141:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787359906.228189:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527821952:0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.228232:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787359906.228267:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40984700 x1874182527821824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359906.228284:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527821824:0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.228364:0:5863:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787359906.228375:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821952 00000100:00100000:2.0:1787359906.228378:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821952 00000100:00100000:2.0:1787359906.228400:0:5863:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787359906.228407:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359906.228413:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527821568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.228449:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527821568:12345-0@lo:400:kworker.0 Request processed in 36us (4863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359906.228456:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359906.228466:0:5863:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787359906.228479:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787359906.228485:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527821952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359906.228517:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527821952:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359906.228523:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787359906.228541:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359906.228546:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787359906.228549:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359906.228568:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527821952:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.229049:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527821440 00000100:00100000:3.0:1787359906.229056:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527821440 00000100:00100000:3.0:1787359906.229194:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787359906.229209:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527821440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.229265:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527821440:12345-0@lo:400:kworker.0 Request processed in 57us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359906.229273:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787359906.229342:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527821568:0@lo:400:kworker.0 00010000:00080000:3.0:1787359906.229359:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40987480 x1874182527822080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359906.229369:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527822080:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.229396:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527821440:0@lo:400:kworker.0 00000100:00100000:0.0:1787359906.230325:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527821696:12345-0@lo:400:kworker.0 Request processed in 6453us (6891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359906.230338:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787359906.230446:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527821696:0@lo:400:kworker.0 00000100:00100000:3.0:1787359906.726988:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527822208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359906.727406:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359906.727505:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822208 00000100:00100000:3.0:1787359906.727516:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822208 00000100:00100000:3.0:1787359906.729434:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359906.729462:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527822208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787359906.729515:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359906.729605:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527822208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359906.729613:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787359906.736521:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e241180 x1874182527822208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359906.736653:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527822208:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359906.856417:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359907.880182:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359907.925762:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359907.925809:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359907.925933:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913536 00000100:00100000:3.0:1787359907.925943:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913536 00000100:00100000:3.0:1787359907.926001:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 206 00000100:00100000:3.0:1787359907.926012:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2362:x1874182508913536:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359907.926087:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:2362:x1874182508913536:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 77us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359907.926094:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 206 00000100:00100000:0.0:1787359907.926725:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913664 00000100:00100000:0.0:1787359907.926731:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913664 00000100:00100000:0.0:1787359907.926786:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:0.0:1787359907.926795:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508913664:12345-192.168.201.14@tcp:400:kworker.0 00000100:00080000:2.0:1787359907.926905:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359907.926978:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508913664:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 185us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359907.926987:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:2.0:1787359908.775185:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527822336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359908.775264:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359908.775385:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822336 00000100:00100000:0.0:1787359908.775393:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822336 00000100:00100000:0.0:1787359908.775458:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787359908.775467:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527822336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359908.775500:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787359908.775588:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359908.783593:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527822336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8115us (8316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359908.783614:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787359908.793417:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e241180 x1874182527822336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359908.793444:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527822336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787359908.905275:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359909.930650:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787359910.450819:0:10129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:51:47 (1787359907) === 00000100:00100000:2.0:1787359910.841480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359910.855858:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913792 00000100:00100000:1.0:1787359910.855882:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913792 00000100:00100000:1.0:1787359910.856010:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 207 00000100:00100000:1.0:1787359910.856025:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+10:8129:x1874182508913792:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787359910.856048:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359910.856091:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165b000/0x72f6de40e4ef37af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce40c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359910.856131:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165b000/0x72f6de40e4ef37af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce40c expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359910.856143:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165b000/0x72f6de40e4ef37af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce40c expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359910.856154:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165b000, rc 0) 00000100:00100000:1.0:1787359910.856239:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+11:8129:x1874182508913792:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 217us (14772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359910.856247:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 207 00000100:00100000:1.0:1787359910.866587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359910.874988:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508913920 00000100:00100000:0.0:1787359910.875010:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508913920 00000100:00100000:0.0:1787359910.875101:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 208 00000100:00100000:0.0:1787359910.875113:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+11:8129:x1874182508913920:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787359910.875508:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+11:8129:x1874182508913920:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 395us (8934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.875517:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 208 00000100:00100000:0.0:1787359910.880904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359910.881089:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914048 00000100:00100000:1.0:1787359910.881103:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914048 00000100:00100000:1.0:1787359910.881174:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 209 00000100:00100000:1.0:1787359910.881188:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+11:8129:x1874182508914048:12345-192.168.201.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787359910.881590:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+11:8129:x1874182508914048:12345-192.168.201.14@tcp:503:mount.lustre.0 Request processed in 403us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359910.881600:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 209 00000100:00100000:1.0:1787359910.886865:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359910.886959:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914176 00000100:00100000:2.0:1787359910.886974:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914176 00000100:00100000:2.0:1787359910.887059:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 210 00000100:00100000:2.0:1787359910.887072:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+11:8133:x1874182508914176:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787359910.887426:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+11:8133:x1874182508914176:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 355us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359910.887436:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 210 00000100:00100000:1.0:1787359910.915335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359910.915439:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914304 00000100:00100000:2.0:1787359910.915467:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914304 00000100:00100000:2.0:1787359910.915548:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 211 00000100:00100000:2.0:1787359910.915560:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+11:8133:x1874182508914304:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787359910.916146:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+11:8133:x1874182508914304:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 586us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359910.916157:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 211 00000100:00100000:2.0:1787359910.922943:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359910.923120:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914432 00000100:00100000:0.0:1787359910.923136:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914432 00000100:00100000:0.0:1787359910.923214:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 212 00000100:00100000:0.0:1787359910.923227:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+11:8129:x1874182508914432:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787359910.923256:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359910.923283:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41e00/0x72f6de40e4ef37b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce436 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359910.923325:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41e00/0x72f6de40e4ef37b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce436 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359910.923340:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41e00/0x72f6de40e4ef37b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce436 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359910.923351:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41e00, rc 0) 00000100:00100000:0.0:1787359910.923434:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+12:8129:x1874182508914432:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 208us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.923477:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 212 00000100:00100000:0.0:1787359910.935393:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359910.935490:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914560 00000100:00100000:1.0:1787359910.935506:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914560 00000100:00100000:1.0:1787359910.935576:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 213 00000100:00100000:1.0:1787359910.935588:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:8129:x1874182508914560:12345-192.168.201.14@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787359910.935644:0:5855:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787359910.935664:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787359910.935669:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787359910.935672:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787359910.935713:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787359910.939434:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:8129:x1874182508914560:12345-192.168.201.14@tcp:256:mount.lustre.0 Request processed in 3830us (4040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359910.939452:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 213 00000100:00100000:3.0:1787359910.944481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359910.945163:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914688 00000100:00100000:2.0:1787359910.945181:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914688 00000100:00100000:2.0:1787359910.945273:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 214 00000100:00100000:2.0:1787359910.945287:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:8129:x1874182508914688:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787359910.945312:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359910.945338:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce43d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359910.945378:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359910.945390:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359910.945401:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346e00, rc 0) 00000100:00100000:2.0:1787359910.945491:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:8129:x1874182508914688:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 207us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359910.945517:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 214 00000100:00100000:1.0:1787359910.949943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359910.950128:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914816 00000100:00100000:2.0:1787359910.950143:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914816 00000100:00100000:2.0:1787359910.950225:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 215 00000100:00100000:2.0:1787359910.950247:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:8129:x1874182508914816:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787359910.950629:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:8129:x1874182508914816:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 385us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359910.950635:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 215 00000100:00100000:3.0:1787359910.952098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359910.952169:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508914944 00000100:00100000:0.0:1787359910.952185:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508914944 00000100:00100000:0.0:1787359910.952262:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 216 00000100:00100000:0.0:1787359910.952273:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:8129:x1874182508914944:12345-192.168.201.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787359910.952565:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:8129:x1874182508914944:12345-192.168.201.14@tcp:503:mount.lustre.0 Request processed in 293us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.952574:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 216 00010000:00010000:2.0:1787359910.953097:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359910.955163:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359910.956601:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915072 00000100:00100000:0.0:1787359910.956622:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915072 00000100:00100000:0.0:1787359910.956756:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 217 00000100:00100000:0.0:1787359910.956769:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:8137:x1874182508915072:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787359910.957124:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:8137:x1874182508915072:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 357us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.957134:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 217 00000100:00100000:3.0:1787359910.969464:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359910.969658:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915200 00000100:00100000:1.0:1787359910.969722:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915200 00000100:00100000:1.0:1787359910.969810:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 218 00000100:00100000:1.0:1787359910.969824:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:8137:x1874182508915200:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787359910.970175:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:8137:x1874182508915200:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 352us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359910.970184:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 218 00000100:00100000:3.0:1787359910.974035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359910.974084:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359910.975661:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915456 00000100:00100000:0.0:1787359910.975725:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915456 00000100:00100000:0.0:1787359910.975832:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915328 00000100:00100000:0.0:1787359910.975836:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915328 00000100:00100000:0.0:1787359910.975865:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:0.0:1787359910.975878:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508915456:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359910.976006:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508915456:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 117us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.976015:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:0.0:1787359910.976057:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:0.0:1787359910.976062:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874182508915328:12345-192.168.201.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787359910.976092:0:5861:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 656feb27-2023-42fb-9cb9-36f15421ff39@192.168.201.14@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:0.0:1787359910.976151:0:5861:0:(genops.c:1385:class_connect()) connect: client 656feb27-2023-42fb-9cb9-36f15421ff39, cookie 0x72f6de40e4ef37c4 00000004:00100000:0.0:1787359910.976192:0:5861:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787359910.976769:0:5861:0:(import.c:65:import_set_state_nolock()) ffff983d399b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787359910.976833:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:2361:x1874182508915328:12345-192.168.201.14@tcp:38:mount.lustre.0 Request processed in 767us (2746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.976843:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00080000:1.0:1787359910.978267:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359910.991428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359910.993154:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915584 00000100:00100000:0.0:1787359910.993176:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915584 00000100:00100000:0.0:1787359910.993297:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:0.0:1787359910.993310:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+6:0:x1874182508915584:12345-192.168.201.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787359910.993372:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787359910.993503:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+6:0:x1874182508915584:12345-192.168.201.14@tcp:41:mount.lustre.0 Request processed in 194us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359910.993511:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00080000:1.0:1787359910.993850:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359911.008267:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359911.008453:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915712 00000100:00100000:0.0:1787359911.008468:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915712 00000100:00100000:0.0:1787359911.008547:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:0.0:1787359911.008560:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:8129:x1874182508915712:12345-192.168.201.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787359911.008604:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787359911.008744:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:8129:x1874182508915712:12345-192.168.201.14@tcp:41:mount.lustre.0 Request processed in 185us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359911.008753:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:3.0:1787359911.014838:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359911.014949:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915840 00000100:00100000:0.0:1787359911.014963:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915840 00000100:00100000:0.0:1787359911.015047:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:0.0:1787359911.015060:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+6:8129:x1874182508915840:12345-192.168.201.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787359911.015187:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+6:8129:x1874182508915840:12345-192.168.201.14@tcp:40:mount.lustre.0 Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359911.015195:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:3.0:1787359911.019775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359911.019825:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359911.019855:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359911.020017:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508915968 00000100:00100000:2.0:1787359911.020034:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508915968 00000100:00100000:2.0:1787359911.020094:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916096 00000100:00100000:2.0:1787359911.020098:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916096 00000100:00100000:2.0:1787359911.020126:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:2.0:1787359911.020137:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182508915968:12345-192.168.201.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787359911.020179:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 656feb27-2023-42fb-9cb9-36f15421ff39@192.168.201.14@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:2.0:1787359911.020220:0:6700:0:(genops.c:1385:class_connect()) connect: client 656feb27-2023-42fb-9cb9-36f15421ff39, cookie 0x72f6de40e4ef37cb 00002000:00100000:2.0:1787359911.020235:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 656feb27-2023-42fb-9cb9-36f15421ff39/ffff983d1e3ff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787359911.020268:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787359911.020566:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787359911.020605:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983d1e3fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359911.020737:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:656feb27-2023-42fb-9cb9-36f15421ff39+6:2361:x1874182508915968:12345-192.168.201.14@tcp:8:mount.lustre.0 Request processed in 598us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359911.020747:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:2.0:1787359911.020774:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:2.0:1787359911.020810:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182508916096:12345-192.168.201.14@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787359911.020830:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 656feb27-2023-42fb-9cb9-36f15421ff39@192.168.201.14@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:2.0:1787359911.020856:0:6700:0:(genops.c:1385:class_connect()) connect: client 656feb27-2023-42fb-9cb9-36f15421ff39, cookie 0x72f6de40e4ef37d2 00002000:00100000:2.0:1787359911.020863:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 656feb27-2023-42fb-9cb9-36f15421ff39/ffff983d1e3f9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787359911.020883:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787359911.021025:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787359911.021042:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983d1e3f8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359911.021081:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:656feb27-2023-42fb-9cb9-36f15421ff39+6:2361:x1874182508916096:12345-192.168.201.14@tcp:8:mount.lustre.0 Request processed in 270us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359911.021088:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:1.0:1787359911.021243:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916224 00000100:00100000:1.0:1787359911.021250:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916224 00000100:00100000:1.0:1787359911.021308:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:1.0:1787359911.021317:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:8129:x1874182508916224:12345-192.168.201.14@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787359911.021622:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787359911.021804:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:8129:x1874182508916224:12345-192.168.201.14@tcp:33:mount.lustre.0 Request processed in 487us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359911.021811:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:2.0:1787359911.335380:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359911.335414:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527822464:0@lo:400:kworker.0 00000100:00100000:2.0:1787359911.335526:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359911.335661:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822464 00000100:00100000:2.0:1787359911.335671:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822464 00000100:00100000:2.0:1787359911.335750:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787359911.335762:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527822464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359911.335835:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527822464:12345-0@lo:400:kworker.0 Request processed in 74us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359911.335843:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787359911.335912:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527822464:0@lo:400:kworker.0 00000100:00100000:2.0:1787359911.337928:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527822848:0@lo:400:kworker.0 00000100:00100000:2.0:1787359911.338021:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359911.338074:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359911.338095:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527822976:0@lo:400:kworker.0 00000100:00100000:2.0:1787359911.338125:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359911.338171:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822848 00000100:00100000:2.0:1787359911.338180:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822848 00000100:00100000:2.0:1787359911.338255:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787359911.338266:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527822848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359911.338333:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527822848:12345-0@lo:400:kworker.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359911.338342:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787359911.338364:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359911.338413:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03f480 x1874182527822848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359911.338428:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527822848:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.338617:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527822592:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.338665:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359911.338725:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527823104:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.338750:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359911.338772:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359911.338778:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527822720:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.338812:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359911.338842:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823104 00000100:00100000:0.0:1787359911.338847:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823104 00000100:00100000:0.0:1787359911.338879:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787359911.338886:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527823104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.338923:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527823104:12345-0@lo:400:kworker.0 Request processed in 38us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359911.338929:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787359911.338954:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12ed80 x1874182527823104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359911.338964:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527823104:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.338985:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822976 00000100:00100000:0.0:1787359911.338998:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822976 00000100:00100000:0.0:1787359911.339026:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822592 00000100:00100000:0.0:1787359911.339029:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822592 00000100:00100000:0.0:1787359911.339038:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527822720 00000100:00100000:0.0:1787359911.339040:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527822720 00000100:00100000:0.0:1787359911.339053:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359911.339058:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527822976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.339093:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527822976:12345-0@lo:400:kworker.0 Request processed in 35us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359911.339098:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359911.339109:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787359911.339115:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527822592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359911.339127:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787359911.339137:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527822720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.339142:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527822592:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359911.339148:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787359911.339169:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527822720:12345-0@lo:400:kworker.0 Request processed in 35us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359911.339170:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527822720:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.339179:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527822592:0@lo:400:kworker.0 00000100:00100000:1.0:1787359911.339181:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787359911.339251:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359911.339255:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359911.339277:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527822976:0@lo:400:kworker.0 00000100:00100000:0.0:1787359911.854549:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359911.854588:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527823232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359911.854754:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359911.856077:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823232 00000100:00100000:1.0:1787359911.856095:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823232 00000100:00100000:1.0:1787359911.856182:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787359911.856197:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527823232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359911.856233:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359911.856332:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527823232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359911.856340:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787359911.856401:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12f480 x1874182527823232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359911.856425:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527823232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787359911.978939:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787359912.025081:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 656feb27-2023-42fb-9cb9-36f15421ff39 00000001:00100000:2.0:1787359912.429513:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 656feb27-2023-42fb-9cb9-36f15421ff39 00000001:00100000:0.0:1787359912.436291:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 656feb27-2023-42fb-9cb9-36f15421ff39 00010000:00010000:2.0:1787359912.998981:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359913.908260:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359913.908300:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527823360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787359913.908386:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359913.908909:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823360 00000100:00100000:3.0:1787359913.908921:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823360 00000100:00100000:3.0:1787359913.908985:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787359913.908996:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527823360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787359913.909031:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359913.909122:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527823360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359913.909130:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787359913.909314:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787359913.909358:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e241f80 x1874182527823360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359913.909392:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527823360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787359914.027907:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359915.050477:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359916.070938:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359916.110809:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359916.110932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359916.110976:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359916.111009:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359916.111032:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359916.111093:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916864 00000100:00100000:3.0:1787359916.111104:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916864 00000100:00100000:3.0:1787359916.111158:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916736 00000100:00100000:3.0:1787359916.111160:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916736 00000100:00100000:3.0:1787359916.111176:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:3.0:1787359916.111185:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508916864:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359916.111254:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508916864:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359916.111262:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:3.0:1787359916.111278:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:3.0:1787359916.111284:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508916736:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359916.111303:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508916736:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 20us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359916.111309:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00080000:3.0:1787359916.111408:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787359916.111412:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787359916.111732:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916608 00000100:00100000:1.0:1787359916.111737:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916608 00000100:00100000:1.0:1787359916.111776:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916480 00000100:00100000:1.0:1787359916.111779:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916480 00000100:00100000:1.0:1787359916.111800:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:1.0:1787359916.111807:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508916608:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359916.111841:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508916608:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 36us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.111848:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:1.0:1787359916.111859:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:1.0:1787359916.111865:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508916480:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359916.111885:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508916480:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 21us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.111907:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00080000:3.0:1787359916.112102:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359916.112928:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916352 00000100:00100000:0.0:1787359916.112936:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916352 00000100:00100000:0.0:1787359916.113092:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 220 00000100:00100000:0.0:1787359916.113103:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508916352:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359916.113164:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508916352:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 63us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359916.113171:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 220 00000100:00100000:0.0:1787359916.455803:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527823744:0@lo:400:kworker.0 00000100:00100000:0.0:1787359916.455886:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359916.455952:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787359916.455953:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527823872:0@lo:400:kworker.0 00000100:00100000:0.0:1787359916.455957:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527823616:0@lo:400:kworker.0 00000100:00100000:0.0:1787359916.455979:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359916.455984:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359916.455997:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527824128:0@lo:400:kworker.0 00000100:00100000:1.0:1787359916.456008:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787359916.456014:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527823488:0@lo:400:kworker.0 00000100:00100000:1.0:1787359916.456041:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359916.456061:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527824000:0@lo:400:kworker.0 00000100:00100000:1.0:1787359916.456083:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359916.456112:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823488 00000100:00100000:1.0:1787359916.456119:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823488 00000100:00100000:2.0:1787359916.456136:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823744 00000100:00100000:2.0:1787359916.456139:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823744 00000100:00100000:1.0:1787359916.456162:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787359916.456170:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527823488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359916.456182:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823616 00000100:00100000:2.0:1787359916.456185:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823616 00000100:00100000:2.0:1787359916.456197:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824000 00000100:00100000:2.0:1787359916.456199:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824000 00000100:00100000:2.0:1787359916.456214:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787359916.456216:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527823488:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359916.456220:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359916.456223:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787359916.456255:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787359916.456261:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527823616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359916.456269:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527823744:12345-0@lo:400:kworker.0 Request processed in 50us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359916.456275:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787359916.456284:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527823616:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359916.456288:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787359916.456293:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527824000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359916.456394:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527824000:12345-0@lo:400:kworker.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00080000:3.0:1787359916.456454:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359916.456480:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527823872 00000100:00100000:3.0:1787359916.456483:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527823872 00000100:00100000:3.0:1787359916.456517:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787359916.456524:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527823872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359916.456561:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527823872:12345-0@lo:400:kworker.0 Request processed in 38us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359916.456567:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787359916.456585:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359916.456634:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527823488:0@lo:400:kworker.0 00000100:00100000:3.0:1787359916.456647:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527824000:0@lo:400:kworker.0 00010000:00080000:3.0:1787359916.456658:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d08637100 x1874182527823872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359916.456669:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527823872:0@lo:400:kworker.0 00000100:00100000:0.0:1787359916.456949:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359916.456987:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527823744:0@lo:400:kworker.0 00000100:00100000:0.0:1787359916.457016:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527823616:0@lo:400:kworker.0 00000100:00100000:3.0:1787359916.461612:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824128 00000100:00100000:3.0:1787359916.461628:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824128 00000100:00100000:3.0:1787359916.461764:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787359916.461775:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527824128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359916.461881:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527824128:12345-0@lo:400:kworker.0 Request processed in 108us (4931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359916.461889:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787359916.463038:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787359916.463092:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d08634a80 x1874182527824128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359916.463110:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527824128:0@lo:400:kworker.0 00000100:00100000:1.0:1787359916.470213:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787359916.470524:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787359916.967864:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359916.967888:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527824256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359916.967974:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359916.968077:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824256 00000100:00100000:1.0:1787359916.968086:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824256 00000100:00100000:1.0:1787359916.968146:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787359916.968156:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527824256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359916.968210:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359916.968275:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527824256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359916.968283:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787359916.968423:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f4e00 x1874182527824256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359916.968450:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527824256:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359917.094859:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787359918.005544:0:10326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787359918.119979:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359919.015458:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527824384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359919.015617:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359919.016352:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824384 00000100:00100000:0.0:1787359919.016361:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824384 00000100:00080000:2.0:1787359919.016420:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359919.016439:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787359919.016450:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527824384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359919.016486:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359919.016667:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527824384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 218us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359919.016675:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787359919.016785:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d08634a80 x1874182527824384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359919.016806:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527824384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787359919.143865:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359920.170593:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359921.201178:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359921.243025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359921.243142:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359921.243175:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359921.243199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359921.243218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359921.243320:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917248 00000100:00100000:1.0:1787359921.243330:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917248 00000100:00100000:1.0:1787359921.243383:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917120 00000100:00100000:1.0:1787359921.243385:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917120 00000100:00100000:1.0:1787359921.243404:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:1.0:1787359921.243412:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917248:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359921.243479:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917248:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359921.243486:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:1.0:1787359921.243503:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:1.0:1787359921.243509:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508917120:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359921.243531:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508917120:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359921.243538:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00080000:1.0:1787359921.243555:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359921.243594:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917504 00000100:00100000:3.0:1787359921.243597:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917504 00000100:00100000:3.0:1787359921.243638:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917376 00000100:00100000:3.0:1787359921.243641:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917376 00000100:00100000:3.0:1787359921.243656:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:3.0:1787359921.243662:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917504:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359921.243775:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917504:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 112us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359921.243781:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:3.0:1787359921.243795:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:3.0:1787359921.243801:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917376:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359921.243826:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917376:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359921.243831:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:0.0:1787359921.243952:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508916992 00000100:00100000:0.0:1787359921.243957:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508916992 00000100:00100000:0.0:1787359921.243992:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 222 00000100:00100000:0.0:1787359921.243999:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508916992:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359921.244021:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508916992:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 24us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.244027:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 222 00000100:00080000:1.0:1787359921.244813:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359921.244820:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787359921.586848:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527824640:0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.586929:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359921.586986:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527825152:0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.587016:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359921.587046:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359921.587052:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527824768:0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.587074:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359921.587115:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824640 00000100:00100000:0.0:1787359921.587123:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824640 00000100:00100000:0.0:1787359921.587185:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824768 00000100:00100000:0.0:1787359921.587190:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824768 00000100:00100000:0.0:1787359921.587222:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787359921.587229:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527824640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.587279:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527824640:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.587287:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787359921.587304:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787359921.587310:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527824768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.587336:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527824768:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.587342:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787359921.587359:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825152 00000100:00100000:0.0:1787359921.587362:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825152 00000100:00100000:0.0:1787359921.587388:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787359921.587395:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a06c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527825152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.587423:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a06c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527825152:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.587428:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787359921.587589:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787359921.587595:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359921.587632:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527824768:0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.587643:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527824640:0@lo:400:kworker.0 00010000:00080000:0.0:1787359921.587654:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a20ce00 x1874182527825152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359921.587700:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527825152:0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.587982:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527824512:0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.588018:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359921.588060:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527825024:0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.588083:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359921.588103:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359921.588109:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527824896:0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.588131:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359921.588160:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825024 00000100:00100000:2.0:1787359921.588177:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825024 00000100:00100000:2.0:1787359921.588215:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787359921.588222:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527825024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.588267:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527825024:12345-0@lo:400:kworker.0 Request processed in 45us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359921.588274:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787359921.588293:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824896 00000100:00100000:2.0:1787359921.588297:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824896 00000100:00100000:2.0:1787359921.588321:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787359921.588327:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527824896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.588358:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527824896:12345-0@lo:400:kworker.0 Request processed in 31us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359921.588364:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787359921.588377:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787359921.588380:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787359921.588401:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d08634e00 x1874182527824896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359921.588411:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527824896:0@lo:400:kworker.0 00000100:00100000:2.0:1787359921.588421:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527825024:0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.588711:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527824512 00000100:00100000:0.0:1787359921.588716:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527824512 00000100:00100000:0.0:1787359921.588742:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787359921.588749:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527824512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359921.588784:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527824512:12345-0@lo:400:kworker.0 Request processed in 35us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359921.588790:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787359921.589352:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08636d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527824512:0@lo:400:kworker.0 00000100:00100000:3.0:1787359922.087045:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527825280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359922.087117:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359922.087197:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825280 00000100:00100000:3.0:1787359922.087205:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825280 00000100:00100000:3.0:1787359922.087251:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787359922.087259:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527825280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787359922.087307:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359922.087355:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527825280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359922.087362:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787359922.087405:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f5500 x1874182527825280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359922.087426:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527825280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787359922.215357:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359923.239186:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359924.135961:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359924.135987:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527825408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359924.136058:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359924.136288:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825408 00000100:00100000:0.0:1787359924.136297:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825408 00000100:00100000:0.0:1787359924.136364:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787359924.136375:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527825408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359924.136417:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359924.136469:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527825408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359924.136476:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787359924.136518:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a20ce00 x1874182527825408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359924.136538:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527825408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787359924.136666:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359924.264900:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359925.290435:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359926.311403:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359926.346151:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359926.346187:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359926.346210:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359926.346230:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359926.346257:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359926.346291:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917760 00000100:00100000:3.0:1787359926.346302:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917760 00000100:00100000:3.0:1787359926.346358:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917888 00000100:00100000:3.0:1787359926.346361:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917888 00000100:00100000:3.0:1787359926.346380:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:3.0:1787359926.346390:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508917760:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359926.346473:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508917760:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.346481:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:3.0:1787359926.346499:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:3.0:1787359926.346506:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917888:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359926.346543:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508917888:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.346558:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:3.0:1787359926.346579:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918016 00000100:00100000:3.0:1787359926.346582:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918016 00000100:00100000:3.0:1787359926.346607:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918144 00000100:00100000:3.0:1787359926.346610:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918144 00000100:00100000:3.0:1787359926.346623:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:3.0:1787359926.346629:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508918016:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359926.346657:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508918016:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.346662:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:3.0:1787359926.346673:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:3.0:1787359926.346703:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508918144:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359926.346726:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508918144:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 25us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.346732:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:3.0:1787359926.346751:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508917632 00000100:00100000:3.0:1787359926.346754:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508917632 00000100:00100000:3.0:1787359926.346779:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 224 00000100:00100000:3.0:1787359926.346785:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508917632:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359926.346807:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508917632:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.346812:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 224 00000100:00080000:3.0:1787359926.346841:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359926.346844:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787359926.346847:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359926.718352:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527825536:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.718501:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359926.718576:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527826048:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.718606:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359926.718775:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787359926.718798:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527825920:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.718827:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359926.718874:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825536 00000100:00100000:0.0:1787359926.718881:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825536 00000100:00100000:0.0:1787359926.718928:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787359926.718938:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527825536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.718990:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527825536:12345-0@lo:400:kworker.0 Request processed in 53us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359926.718997:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787359926.719029:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826048 00000100:00100000:0.0:1787359926.719032:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826048 00000100:00100000:2.0:1787359926.722661:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527825664:0@lo:400:kworker.0 00000100:00100000:2.0:1787359926.722756:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359926.722809:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527826176:0@lo:400:kworker.0 00000100:00100000:2.0:1787359926.722835:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359926.722891:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359926.722899:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527825792:0@lo:400:kworker.0 00000100:00100000:2.0:1787359926.722923:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359926.724331:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825920 00000100:00100000:0.0:1787359926.724343:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825920 00000100:00100000:0.0:1787359926.724554:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826176 00000100:00100000:0.0:1787359926.724558:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826176 00000100:00100000:0.0:1787359926.724580:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787359926.724589:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527825920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.724672:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527825920:12345-0@lo:400:kworker.0 Request processed in 84us (5844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359926.724696:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787359926.724712:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787359926.724718:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527826176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.724747:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527826176:12345-0@lo:400:kworker.0 Request processed in 30us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359926.724753:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1787359926.724772:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787359926.724776:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787359926.724779:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787359926.724821:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12df80 x1874182527825920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359926.724836:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527825920:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.725453:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527825536:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.728712:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825664 00000100:00100000:0.0:1787359926.728727:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825664 00000100:00100000:0.0:1787359926.728769:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527825792 00000100:00100000:0.0:1787359926.728773:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527825792 00000100:00080000:0.0:1787359926.728823:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359926.728851:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787359926.728862:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527826048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.728959:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527826048:12345-0@lo:400:kworker.0 Request processed in 99us (10351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359926.728967:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787359926.729017:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527826048:0@lo:400:kworker.0 00010000:00080000:2.0:1787359926.729638:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12c380 x1874182527826176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359926.729651:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527826176:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.730137:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787359926.730551:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787359926.730561:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527825792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359926.730640:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527825792:12345-0@lo:400:kworker.0 Request processed in 81us (7715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359926.730647:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787359926.730851:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527825792:0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.738405:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527825664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359926.738506:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527825664:12345-0@lo:400:kworker.0 Request processed in 8359us (15749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359926.738515:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787359926.741644:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527825664:0@lo:400:kworker.0 00000100:00100000:1.0:1787359927.207812:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527826304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359927.207899:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359927.207988:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826304 00000100:00100000:1.0:1787359927.207997:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826304 00000100:00100000:1.0:1787359927.208069:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787359927.208080:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527826304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359927.208122:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359927.208170:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527826304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359927.208177:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787359927.208220:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f4380 x1874182527826304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359927.208239:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527826304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787359927.334847:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359928.365366:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359929.258258:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359929.258293:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527826432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359929.258363:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359929.259091:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826432 00000100:00100000:1.0:1787359929.259101:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826432 00000100:00100000:1.0:1787359929.259163:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787359929.259175:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527826432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787359929.259214:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359929.259271:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527826432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359929.259279:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787359929.259299:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787359929.259332:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40985180 x1874182527826432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359929.259352:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527826432:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787359929.407624:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359930.407889:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359931.440585:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359931.468212:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359931.468244:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359931.468437:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918272 00000100:00100000:3.0:1787359931.468456:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918272 00000100:00100000:3.0:1787359931.468510:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 226 00000100:00100000:3.0:1787359931.468518:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508918272:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359931.468589:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508918272:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359931.468597:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 226 00000100:00100000:2.0:1787359931.469202:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359931.469797:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918528 00000100:00100000:3.0:1787359931.469805:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918528 00000100:00100000:3.0:1787359931.469856:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918400 00000100:00100000:3.0:1787359931.469859:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918400 00000100:00100000:3.0:1787359931.469880:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:3.0:1787359931.469887:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508918528:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359931.469938:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508918528:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 52us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359931.469944:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:3.0:1787359931.469958:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:3.0:1787359931.469963:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508918400:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359931.469984:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508918400:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 21us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359931.470008:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00080000:2.0:1787359931.471436:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359931.473746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359931.473781:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359931.473811:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918656 00000100:00100000:3.0:1787359931.473820:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918656 00000100:00100000:3.0:1787359931.473874:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918784 00000100:00100000:3.0:1787359931.473877:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918784 00000100:00100000:3.0:1787359931.473895:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:3.0:1787359931.473905:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2361:x1874182508918656:12345-192.168.201.14@tcp:9:kworker.0 00000020:00000080:3.0:1787359931.473933:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef37cb 00000100:00080000:3.0:1787359931.473943:0:6698:0:(import.c:65:import_set_state_nolock()) ffff983d1e3fa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787359931.473979:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787359931.476819:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+2:2361:x1874182508918656:12345-192.168.201.14@tcp:9:kworker.0 Request processed in 2902us (3069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359931.476835:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:3.0:1787359931.476878:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:3.0:1787359931.476893:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2361:x1874182508918784:12345-192.168.201.14@tcp:9:kworker.0 00000020:00000080:3.0:1787359931.476920:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef37d2 00000100:00080000:3.0:1787359931.476930:0:6698:0:(import.c:65:import_set_state_nolock()) ffff983d1e3f8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787359931.476968:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787359931.478648:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:656feb27-2023-42fb-9cb9-36f15421ff39+2:2361:x1874182508918784:12345-192.168.201.14@tcp:9:kworker.0 Request processed in 1750us (4853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359931.478662:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00080000:3.0:1787359931.478730:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359931.478736:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359931.478751:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359931.478777:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359931.817695:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527826688:0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.817767:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359931.817832:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527827200:0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.817861:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359931.817894:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359931.817900:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527826816:0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.817923:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359931.817952:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826688 00000100:00100000:2.0:1787359931.817959:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826688 00000100:00100000:2.0:1787359931.818016:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826816 00000100:00100000:2.0:1787359931.818019:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826816 00000100:00100000:2.0:1787359931.818046:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787359931.818055:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527826688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.818108:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527826688:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359931.818114:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787359931.818130:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787359931.818136:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527826816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.818162:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527826816:12345-0@lo:400:kworker.0 Request processed in 26us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359931.818167:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787359931.818184:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827200 00000100:00100000:2.0:1787359931.818187:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827200 00000100:00100000:2.0:1787359931.818213:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359931.818219:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527827200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.818246:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527827200:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359931.818259:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787359931.818281:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359931.818285:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359931.818316:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527826816:0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.818327:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527826688:0@lo:400:kworker.0 00010000:00080000:2.0:1787359931.818339:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03c000 x1874182527827200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359931.818349:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527827200:0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818472:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527826560:0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818506:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359931.818541:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527827072:0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818562:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359931.818580:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359931.818585:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818607:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359931.818639:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827072 00000100:00100000:1.0:1787359931.818642:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827072 00000100:00100000:1.0:1787359931.818700:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787359931.818707:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527827072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818743:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527827072:12345-0@lo:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359931.818749:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787359931.818765:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826944 00000100:00100000:1.0:1787359931.818768:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826944 00000100:00100000:1.0:1787359931.818792:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787359931.818798:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818827:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527826944:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359931.818833:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787359931.818847:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359931.818849:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787359931.818866:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03d500 x1874182527826944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359931.818875:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787359931.818900:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527827072:0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.819306:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527826560 00000100:00100000:2.0:1787359931.819311:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527826560 00000100:00100000:2.0:1787359931.819347:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787359931.819354:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527826560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359931.819388:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527826560:12345-0@lo:400:kworker.0 Request processed in 35us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359931.819394:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787359931.819499:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527826560:0@lo:400:kworker.0 00000100:00100000:1.0:1787359932.333851:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527827328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359932.333926:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359932.334006:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827328 00000100:00100000:1.0:1787359932.334014:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827328 00000100:00100000:1.0:1787359932.334057:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787359932.334067:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527827328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359932.334102:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359932.334146:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527827328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359932.334153:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787359932.334191:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12d880 x1874182527827328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359932.334208:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527827328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359932.459790:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787359932.516268:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 656feb27-2023-42fb-9cb9-36f15421ff39 00000020:00000080:2.0:1787359932.516280:0:6724:0:(genops.c:885:class_export_put()) final put ffff983d1e3ff800/656feb27-2023-42fb-9cb9-36f15421ff39 00000020:00000080:2.0:1787359932.516322:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1e3ff800/656feb27-2023-42fb-9cb9-36f15421ff39 for lustre-OST0000 00000020:00000080:2.0:1787359932.516363:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d1e3fa800 for lustre-OST0000 00000001:00100000:1.0:1787359932.931450:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 656feb27-2023-42fb-9cb9-36f15421ff39 00000020:00000080:1.0:1787359932.931460:0:7649:0:(genops.c:885:class_export_put()) final put ffff983d1e3f9800/656feb27-2023-42fb-9cb9-36f15421ff39 00000020:00000080:1.0:1787359932.931491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1e3f9800/656feb27-2023-42fb-9cb9-36f15421ff39 for lustre-OST0001 00000020:00000080:1.0:1787359932.931538:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d1e3f8800 for lustre-OST0001 00010000:00010000:3.0:1787359933.484656:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359934.376924:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359934.376952:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527827456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359934.377052:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359934.377225:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827456 00000100:00100000:2.0:1787359934.377236:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827456 00000100:00100000:2.0:1787359934.377310:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787359934.377322:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527827456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359934.377373:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787359934.378354:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527827456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1027us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359934.378371:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787359934.379282:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369e300 x1874182527827456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359934.379314:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527827456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787359934.380431:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359934.503904:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359935.527640:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359936.552933:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359936.589522:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359936.589661:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508918912 00000100:00100000:1.0:1787359936.589671:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508918912 00000100:00100000:1.0:1787359936.589792:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 228 00000100:00100000:1.0:1787359936.589804:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508918912:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359936.589895:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508918912:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 93us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359936.589903:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 228 00000100:00100000:3.0:1787359936.590332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359936.590480:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359936.590503:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919040 00000100:00100000:3.0:1787359936.590509:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919040 00000100:00100000:3.0:1787359936.590551:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919168 00000100:00100000:3.0:1787359936.590554:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919168 00000100:00100000:3.0:1787359936.590574:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:3.0:1787359936.590582:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508919040:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359936.590626:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508919040:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.590634:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:3.0:1787359936.590651:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:3.0:1787359936.590657:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508919168:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359936.590711:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508919168:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 54us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.590718:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00080000:3.0:1787359936.590735:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359936.945730:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527827968:0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.945806:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.945872:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787359936.945880:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527827584:0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.945921:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.945945:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527828096:0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.945970:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359936.946002:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827968 00000100:00100000:0.0:1787359936.946010:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827968 00000100:00100000:0.0:1787359936.946066:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787359936.946076:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527827968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.946128:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527827968:12345-0@lo:400:kworker.0 Request processed in 54us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.946136:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787359936.946158:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827584 00000100:00100000:0.0:1787359936.946162:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827584 00000100:00100000:0.0:1787359936.946186:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787359936.946192:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527827584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.946221:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527827584:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.946227:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787359936.946273:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527827584:0@lo:400:kworker.0 00010000:00080000:0.0:1787359936.946287:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f7100 x1874182527827968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359936.946300:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527827968:0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.946387:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527827712:0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.946425:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.946457:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527828224:0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.946478:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.946499:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359936.946513:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527827840:0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.946552:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359936.946601:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527828096 00000100:00100000:0.0:1787359936.946701:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827712 00000100:00100000:0.0:1787359936.946706:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827712 00000100:00100000:0.0:1787359936.946730:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527827840 00000100:00100000:0.0:1787359936.946732:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527827840 00000100:00100000:0.0:1787359936.946747:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787359936.946758:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527827712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.946791:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527827712:12345-0@lo:400:kworker.0 Request processed in 34us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.946797:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787359936.946808:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787359936.946814:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527827840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359936.946836:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527827840:12345-0@lo:400:kworker.0 Request processed in 22us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359936.946841:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787359936.946891:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527828096 00000100:00100000:3.0:1787359936.946925:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787359936.946931:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527828096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.946967:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527828096:12345-0@lo:400:kworker.0 Request processed in 36us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.946972:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787359936.946988:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787359936.946992:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359936.947001:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527828224 00000100:00100000:3.0:1787359936.947004:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527828224 00000100:00100000:3.0:1787359936.947027:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787359936.947033:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527828224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.947061:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527828224:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359936.947066:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787359936.947092:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527827840:0@lo:400:kworker.0 00000100:00100000:3.0:1787359936.947102:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527827712:0@lo:400:kworker.0 00010000:00080000:3.0:1787359936.947112:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f4e00 x1874182527828224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359936.947121:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527828224:0@lo:400:kworker.0 00000100:00080000:3.0:1787359936.947141:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787359936.947154:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527828096:0@lo:400:kworker.0 00000001:02000400:0.0:1787359937.413452:0:11027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787359937.453354:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527828352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359937.453427:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359937.453856:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527828352 00000100:00100000:1.0:1787359937.453864:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527828352 00000100:00100000:1.0:1787359937.453914:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787359937.453923:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527828352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359937.453956:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359937.454044:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527828352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359937.454051:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787359937.454818:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f8cf800 x1874182527828352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359937.454839:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527828352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359937.578858:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359938.598883:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359939.495329:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787359939.495356:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527828480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359939.495430:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359939.495711:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527828480 00000100:00100000:2.0:1787359939.495720:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527828480 00000100:00080000:3.0:1787359939.495795:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359939.495804:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787359939.495821:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527828480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359939.496051:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787359939.496121:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527828480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359939.496129:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787359939.496338:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ce00 x1874182527828480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359939.496369:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527828480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787359939.642809:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359940.646895:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787359941.183101:0:11174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff23ef6c00 20000000:00000080:3.0:1787359941.183117:0:11174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983d3f25b000 uarg=0000000000000000 20000000:01000000:3.0:1787359941.183222:0:11174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787359941.183228:0:11174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787359941.183232:0:11174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787359941.184009:0:11175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787359941.184213:0:11174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787359941.190661:0:11174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787359941.190736:0:11174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190756:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190765:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190771:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190802:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190810:0:11174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190818:0:11174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190862:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.190878:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 12 pid: 5853 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.191010:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828608:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359941.191397:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.191407:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 12 pid: 5856 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.191416:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828736:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359941.191447:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.191456:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 18 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.191491:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828864:0@lo:104: 00000100:00100000:3.0:1787359941.191532:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359941.191578:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.191587:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 18 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.191596:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828992:0@lo:104: 00000100:00100000:3.0:1787359941.191617:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787359941.191637:0:11174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.191646:0:11174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 18 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.191655:0:11174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527829120:0@lo:104: 00000100:00100000:3.0:1787359941.191673:0:11174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359941.191713:0:11174:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359941.191911:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527828864 00000100:00100000:1.0:1787359941.191918:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527828864 00000100:00100000:1.0:1787359941.191958:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527828992 00000100:00100000:1.0:1787359941.191961:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527828992 00000100:00100000:1.0:1787359941.191970:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829120 00000100:00100000:1.0:1787359941.191972:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829120 00000100:00100000:1.0:1787359941.191985:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787359941.192000:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+5:11174:x1874182527828864:12345-0@lo:104: 00010000:00010000:1.0:1787359941.192012:0:7638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192070:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359941.192076:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+5:11174:x1874182527828864:12345-0@lo:104: Request processed in 78us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.192084:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787359941.192102:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787359941.192108:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+4:11174:x1874182527828992:12345-0@lo:104: 00010000:00010000:1.0:1787359941.192116:0:7638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192160:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787359941.192165:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+4:11174:x1874182527828992:12345-0@lo:104: Request processed in 57us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.192171:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787359941.192183:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787359941.192190:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11174:x1874182527829120:12345-0@lo:104: 00010000:00010000:1.0:1787359941.192196:0:7638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192230:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787359941.192234:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11174:x1874182527829120:12345-0@lo:104: Request processed in 45us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.192240:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787359941.192259:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787359941.192270:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192292:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01677400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787359941.192297:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192306:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359941.192314:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359941.192320:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787359941.192350:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192357:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359941.192375:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192383:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01677400/0x72f6de40e4ef379a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37a1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192397:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787359941.192401:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192408:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01677c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787359941.192411:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192428:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359941.192435:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359941.192441:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787359941.192453:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192459:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359941.192472:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192493:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01677c00/0x72f6de40e4ef378c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3793 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192503:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359941.192506:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192512:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787359941.192515:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192522:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359941.192529:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359941.192540:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787359941.192555:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192560:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787359941.192566:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192573:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef377e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3785 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192585:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359941.192587:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359941.192588:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359941.192595:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359941.192600:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359941.192611:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527829248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359941.192650:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359941.192708:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527829376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359941.192732:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359941.192751:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359941.192756:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527829504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359941.192775:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359941.192804:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829248 00000100:00100000:1.0:1787359941.192809:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829248 00010000:00010000:1.0:1787359941.192828:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 19 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.192861:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829376 00000100:00100000:1.0:1787359941.192863:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829376 00010000:00010000:1.0:1787359941.192876:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 20 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.192885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829504 00000100:00100000:1.0:1787359941.192888:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829504 00010000:00010000:1.0:1787359941.192897:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 21 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.192908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787359941.192914:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+21:3320:x1874182527829248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359941.192923:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359941.192928:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 21 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192936:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 21 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.192951:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359941.192979:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+21:3320:x1874182527829248:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.192985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787359941.193023:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359941.193029:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3317:x1874182527829376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359941.193036:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359941.193045:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 20 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.193063:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 20 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.193073:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359941.193100:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3317:x1874182527829376:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.193107:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787359941.193121:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359941.193127:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3317:x1874182527829504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359941.193134:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359941.193139:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 19 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.193147:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 19 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.193156:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359941.193177:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3317:x1874182527829504:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.193183:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359941.193222:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527829248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359941.193245:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527829504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359941.193252:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527829376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787359941.193791:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676000/0x72f6de40e4ef37a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef379a expref: 18 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.193805:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828864:0@lo:104: 00010000:00010000:3.0:1787359941.193816:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01677000/0x72f6de40e4ef3793 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef378c expref: 17 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.193825:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828992:0@lo:104: 00010000:00010000:3.0:1787359941.193835:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676200/0x72f6de40e4ef3785 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef377e expref: 16 pid: 5853 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359941.193852:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527829120:0@lo:104: 00000100:00100000:3.0:1787359941.198527:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359941.198620:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828608:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359941.198633:0:11174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11174:1874182527828736:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359941.198666:0:11174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.198818:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919296 00000100:00100000:3.0:1787359941.198824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359941.198828:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919296 00010000:00010000:1.0:1787359941.198872:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 13 pid: 5853 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.198990:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919424 00000100:00100000:1.0:1787359941.198994:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919424 00010000:00010000:1.0:1787359941.199008:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 14 pid: 5856 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.199036:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 28 00000100:00100000:1.0:1787359941.199046:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+14:2362:x1874182508919296:12345-192.168.201.14@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787359941.199052:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:3.0:1787359941.199059:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03658e77-9945-4faf-b424-380f2de8cb18+14:2362:x1874182508919424:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359941.199059:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359941.199065:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359941.199065:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 14 pid: 5853 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.199069:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 14 pid: 5856 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.199076:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 14 pid: 5853 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.200413:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 14 pid: 5856 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.200439:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce405 expref: 14 pid: 5856 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359941.200457:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359941.200532:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508919424:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 1472us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359941.200541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 29 00010000:00010000:1.0:1787359941.203961:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d05346e00/0x72f6de40e4ef37bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce43d expref: 12 pid: 5853 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.203985:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.203994:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204018:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204025:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204052:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204058:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204064:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359941.204069:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204076:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204101:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359941.204111:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359941.204440:0:11174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359941.204450:0:11174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359941.204458:0:11174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b63e00/0x72f6de40e4ef37d9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359941.204918:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+11:2362:x1874182508919296:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 5870us (6398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359941.204929:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 28 00010000:00010000:1.0:1787359941.673459:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359941.706794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359941.706847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359941.706989:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919552 00000100:00100000:0.0:1787359941.707000:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919552 00000100:00100000:0.0:1787359941.707069:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919680 00000100:00100000:0.0:1787359941.707089:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919680 00000100:00100000:0.0:1787359941.707121:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 89 00000100:00100000:0.0:1787359941.707131:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508919552:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359941.707416:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508919552:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 285us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359941.707423:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 89 00000100:00100000:0.0:1787359941.707440:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 90 00000100:00100000:0.0:1787359941.707446:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508919680:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359941.707469:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508919680:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 24us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359941.707475:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 90 00000100:00080000:3.0:1787359941.707778:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359942.056517:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527829632:0@lo:400:kworker.0 00000100:00100000:1.0:1787359942.056613:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.056999:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829632 00000100:00100000:0.0:1787359942.057008:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829632 00000100:00100000:0.0:1787359942.057074:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787359942.057083:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527829632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359942.058779:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527829760:0@lo:400:kworker.0 00000100:00100000:3.0:1787359942.058842:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.058915:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829760 00000100:00100000:3.0:1787359942.058922:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829760 00000100:00100000:3.0:1787359942.058983:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787359942.058992:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527829760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359942.059043:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527829760:12345-0@lo:400:kworker.0 Request processed in 52us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.059050:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787359942.059096:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527829760:0@lo:400:kworker.0 00000100:00100000:0.0:1787359942.071588:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3319:x1874182527829632:12345-0@lo:400:kworker.0 Request processed in 14496us (14965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.071615:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787359942.074481:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527830016:0@lo:400:kworker.0 00000100:00100000:2.0:1787359942.074574:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.074634:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359942.074641:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527829888:0@lo:400:kworker.0 00000100:00100000:2.0:1787359942.074668:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.074721:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830016 00000100:00100000:2.0:1787359942.074728:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830016 00000100:00100000:2.0:1787359942.075079:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787359942.075091:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527830016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359942.075344:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527830016:12345-0@lo:400:kworker.0 Request processed in 255us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.075352:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787359942.075381:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527829888 00000100:00100000:2.0:1787359942.075386:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527829888 00000100:00100000:2.0:1787359942.075415:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787359942.075422:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527829888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359942.075455:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527829888:12345-0@lo:400:kworker.0 Request processed in 34us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.075461:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787359942.075497:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359942.075501:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359942.075514:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527830272:0@lo:400:kworker.0 00000100:00100000:3.0:1787359942.078270:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527829888:0@lo:400:kworker.0 00010000:00080000:3.0:1787359942.078310:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ea00 x1874182527830016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359942.078332:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527830016:0@lo:400:kworker.0 00000100:00100000:2.0:1787359942.079073:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.079115:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787359942.080044:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527830144:0@lo:400:kworker.0 00000100:00100000:2.0:1787359942.080093:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.080442:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830144 00000100:00100000:0.0:1787359942.080450:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830144 00000100:00100000:0.0:1787359942.080546:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787359942.080558:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527830144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359942.080632:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527830144:12345-0@lo:400:kworker.0 Request processed in 77us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.080639:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787359942.080887:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830272 00000100:00100000:3.0:1787359942.080891:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830272 00000100:00100000:3.0:1787359942.080932:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787359942.080946:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527830272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359942.080984:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527830272:12345-0@lo:400:kworker.0 Request processed in 46us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359942.080990:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787359942.081286:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359942.081292:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359942.081326:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527830144:0@lo:400:kworker.0 00010000:00080000:2.0:1787359942.081342:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ce00 x1874182527830272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359942.081353:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527830272:0@lo:400:kworker.0 00000100:00100000:1.0:1787359942.084795:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527829632:0@lo:400:kworker.0 10000000:01000000:0.0:1787359942.440900:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787359942.440922:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d11588000 from 7 10000000:01000000:0.0:1787359942.440927:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359942.441010:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.441022:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.441034:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359942.441070:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359942.441147:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.441205:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f2e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.441995:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830400 00000100:00100000:1.0:1787359942.442005:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830400 00000100:00100000:1.0:1787359942.442063:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787359942.442073:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527830400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359942.442096:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359942.442111:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef37e0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.442136:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.442147:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.442157:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165bc00, rc 0) 00000100:00100000:1.0:1787359942.442216:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527830400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.442222:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787359942.442850:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359942.442870:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359942.442881:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359942.442991:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359942.443031:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.443068:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216600 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.445446:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830528 00000100:00100000:0.0:1787359942.445459:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830528 00000100:00100000:0.0:1787359942.445536:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787359942.445547:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527830528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359942.452168:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527830528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3872us (6385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.452193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787359942.452603:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359942.452665:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359942.452781:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.452828:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216600 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.453601:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830656 00000100:00100000:0.0:1787359942.453609:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830656 00000100:00100000:1.0:1787359942.460860:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787359942.460881:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527830656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.461126:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527830656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (8343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.461134:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787359942.461244:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787359942.470054:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787359942.477054:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787359942.477091:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359942.477102:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.477115:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787359942.482932:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787359942.482940:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d200eb000 from 7 10000000:01000000:1.0:1787359942.482944:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787359942.482986:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.483003:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.483027:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.483052:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.483116:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.483161:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f5d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.483208:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830784 00000100:00100000:1.0:1787359942.483214:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830784 00000100:00100000:1.0:1787359942.483272:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787359942.483281:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527830784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359942.483293:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359942.483306:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef37ee expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.483327:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.483337:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.483346:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165ba00, rc 0) 00000100:00100000:1.0:1787359942.483382:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527830784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.483388:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787359942.483435:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359942.483449:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.483465:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.483517:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.483541:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.483561:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527830912 00000100:00100000:1.0:1787359942.483565:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527830912 00000100:00100000:1.0:1787359942.483584:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787359942.483590:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527830912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.484070:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527830912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 478us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.484077:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787359942.484101:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f5d2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.484113:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527830912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.484140:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.484177:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359942.484198:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831040 00000100:00100000:1.0:1787359942.484202:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831040 00000100:00100000:1.0:1787359942.484222:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787359942.484229:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527831040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359942.484368:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527831040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.484374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787359942.484402:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d200543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.484422:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787359942.492146:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787359942.492329:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787359942.492349:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359942.492359:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.492371:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359942.492381:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787359942.492383:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d0dccf000 from 7 10000000:01000000:0.0:1787359942.492386:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359942.492438:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.492446:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359942.492457:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359942.492483:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359942.492789:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359942.492832:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f2e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359942.493167:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831168 00000100:00100000:1.0:1787359942.493176:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831168 00000100:00100000:1.0:1787359942.493275:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787359942.493286:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527831168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359942.493300:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359942.493315:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef37fc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.493339:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.493348:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359942.493357:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a000, rc 0) 00000100:00100000:1.0:1787359942.493417:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527831168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359942.493424:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787359942.493997:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359942.494017:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.494027:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359942.494094:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359942.494135:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.500799:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dabcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.501046:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831296 00000100:00100000:0.0:1787359942.501056:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831296 00000100:00100000:0.0:1787359942.501109:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787359942.501120:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527831296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359942.501448:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527831296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (7311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.501466:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787359942.502053:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359942.502107:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359942.502156:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359942.502195:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dabcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359942.502247:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831424 00000100:00100000:0.0:1787359942.502262:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831424 00000100:00100000:0.0:1787359942.502288:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787359942.502295:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527831424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359942.502777:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527831424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 482us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359942.502786:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787359942.502886:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527831424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787359942.504273:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787359942.504473:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787359942.504502:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787359942.504514:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359942.504533:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359942.570155:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527831552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359942.570230:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359942.570350:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831552 00000100:00100000:2.0:1787359942.570359:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831552 00000100:00100000:2.0:1787359942.570516:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787359942.570663:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527831552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359942.572900:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359942.573009:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527831552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2343us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359942.573019:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787359942.573481:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e03c380 x1874182527831552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359942.573506:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527831552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359942.695864:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359943.115924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359943.115964:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919808 00000100:00100000:0.0:1787359943.115974:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919808 00000100:00100000:0.0:1787359943.116043:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 240 00000100:00100000:0.0:1787359943.116053:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+11:5603:x1874182508919808:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359943.116069:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359943.116086:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce467 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359943.116113:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359943.116125:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359943.116150:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787359943.116211:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508919808:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 159us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359943.116219:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 240 00000100:00100000:1.0:1787359943.129955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359943.130006:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508919936 00000100:00100000:3.0:1787359943.130016:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508919936 00000100:00100000:3.0:1787359943.130076:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 241 00000100:00100000:3.0:1787359943.130087:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508919936:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359943.130488:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508919936:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 402us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359943.130497:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 241 00000100:00100000:3.0:1787359943.133987:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359943.139623:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920064 00000100:00100000:1.0:1787359943.139641:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920064 00000100:00100000:1.0:1787359943.139723:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 242 00000100:00100000:1.0:1787359943.139735:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508920064:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787359943.139970:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508920064:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 236us (5994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359943.139978:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 242 00000100:00100000:0.0:1787359943.152724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359943.154976:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920192 00000100:00100000:1.0:1787359943.154992:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920192 00000100:00100000:1.0:1787359943.155060:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 243 00000100:00100000:1.0:1787359943.155070:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508920192:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359943.155088:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359943.155106:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce46e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359943.155213:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359943.155226:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359943.155235:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2800, rc 0) 00000100:00100000:1.0:1787359943.155314:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508920192:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 245us (2597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359943.155322:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 243 00000100:00100000:1.0:1787359943.164580:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359943.164651:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920320 00000100:00100000:3.0:1787359943.164662:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920320 00000100:00100000:3.0:1787359943.164743:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 244 00000100:00100000:3.0:1787359943.164752:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508920320:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359943.165001:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508920320:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 248us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359943.165009:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 244 00000100:00100000:1.0:1787359943.169739:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359943.169828:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920448 00000100:00100000:3.0:1787359943.169839:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920448 00000100:00100000:3.0:1787359943.169896:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 245 00000100:00100000:3.0:1787359943.169906:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508920448:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359943.170123:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508920448:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 218us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359943.170132:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 245 00010000:00010000:1.0:1787359943.719883:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359944.614845:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359944.614871:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527831680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359944.614940:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359944.615075:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831680 00000100:00100000:1.0:1787359944.615092:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831680 00000100:00100000:1.0:1787359944.615161:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787359944.615180:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527831680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787359944.615226:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787359944.615283:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527831680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359944.615291:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787359944.615334:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f8cd180 x1874182527831680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359944.615353:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527831680:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787359944.615484:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359944.742794:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359945.540950:0:11373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787359945.766775:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359946.798304:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359946.834149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359946.834214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359946.834251:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359946.834257:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920576 00000100:00100000:3.0:1787359946.834277:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920576 00000100:00100000:2.0:1787359946.834291:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920832 00000100:00100000:2.0:1787359946.834301:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920832 00000100:00100000:3.0:1787359946.834369:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 246 00000100:00100000:2.0:1787359946.834374:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920704 00000100:00100000:2.0:1787359946.834379:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920704 00000100:00100000:3.0:1787359946.834386:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508920576:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359946.834412:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:2.0:1787359946.834424:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508920832:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359946.834516:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508920576:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359946.834529:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 246 00000100:00080000:3.0:1787359946.837382:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359946.837578:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00100000:3.0:1787359946.837613:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508920704:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359946.844995:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508920832:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 10560us (10769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359946.845010:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:3.0:1787359946.846576:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508920704:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 8962us (12303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359946.846594:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00100000:1.0:1787359947.179346:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527831936:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.179460:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.179529:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527832448:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.179556:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.179590:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787359947.179597:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527831808:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.179645:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.179669:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527832320:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.179737:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.179780:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527832064:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.179807:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.179827:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359947.179834:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527832192:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.179855:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359947.179888:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831936 00000100:00100000:1.0:1787359947.179905:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831936 00000100:00100000:1.0:1787359947.179954:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832320 00000100:00100000:1.0:1787359947.179957:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832320 00000100:00100000:1.0:1787359947.179981:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832064 00000100:00100000:1.0:1787359947.179984:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832064 00000100:00100000:1.0:1787359947.180001:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787359947.180010:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527831936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180080:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527831936:12345-0@lo:400:kworker.0 Request processed in 70us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.180088:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787359947.180106:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787359947.180112:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527832320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180138:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527832320:12345-0@lo:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.180144:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787359947.180155:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787359947.180162:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527832064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180202:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527832064:12345-0@lo:400:kworker.0 Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.180208:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787359947.180228:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832448 00000100:00100000:1.0:1787359947.180231:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832448 00000100:00100000:1.0:1787359947.180256:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832192 00000100:00100000:1.0:1787359947.180259:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832192 00000100:00100000:1.0:1787359947.180273:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787359947.180278:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180309:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527832448:12345-0@lo:400:kworker.0 Request processed in 30us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.180324:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787359947.180336:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787359947.180341:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527832192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180371:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527832192:12345-0@lo:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.180377:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787359947.180475:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527831808 00000100:00100000:1.0:1787359947.180479:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527831808 00000100:00100000:1.0:1787359947.180507:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787359947.180514:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527831808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180545:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527831808:12345-0@lo:400:kworker.0 Request processed in 32us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359947.180552:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1787359947.180594:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359947.180599:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359947.180602:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787359947.180633:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12df80 x1874182527832192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359947.180648:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527832192:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180659:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527832064:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180715:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527831808:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180725:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527832320:0@lo:400:kworker.0 00000100:00100000:1.0:1787359947.180733:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527831936:0@lo:400:kworker.0 00010000:00080000:1.0:1787359947.180759:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f12ed80 x1874182527832448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359947.180768:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527832448:0@lo:400:kworker.0 00000100:00100000:2.0:1787359947.688090:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527832576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787359947.688152:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359947.688385:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832576 00000100:00100000:2.0:1787359947.688395:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832576 00000100:00100000:2.0:1787359947.688449:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787359947.688459:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527832576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359947.688509:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359947.688559:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527832576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359947.688566:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787359947.688633:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d27f26d80 x1874182527832576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359947.688652:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527832576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359947.816764:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359948.840986:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787359949.106518:0:11472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:52:26 (1787359946) === 00000100:00100000:2.0:1787359949.305128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359949.305186:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.305341:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508920960 00000100:00100000:3.0:1787359949.305353:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508920960 00000100:00100000:1.0:1787359949.305539:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508921088 00000100:00100000:1.0:1787359949.305545:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508921088 00000100:00080000:0.0:1787359949.305659:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359949.306059:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:3.0:1787359949.306073:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508920960:12345-192.168.201.14@tcp:41:mkdir.0 00000004:00000024:3.0:1787359949.306131:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787359949.306248:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508920960:12345-192.168.201.14@tcp:41:mkdir.0 Request processed in 178us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.306255:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:3.0:1787359949.306256:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:1.0:1787359949.306263:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9682:x1874182508921088:12345-192.168.201.14@tcp:700:mkdir.0 00000100:00100000:1.0:1787359949.306931:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:9682:x1874182508921088:12345-192.168.201.14@tcp:700:mkdir.0 Request processed in 658us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.306941:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:2.0:1787359949.310415:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.310633:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508921344 00000100:00100000:1.0:1787359949.310645:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508921344 00000100:00100000:1.0:1787359949.310746:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:1.0:1787359949.310756:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:9682:x1874182508921344:12345-192.168.201.14@tcp:36:mkdir.0 00010000:00010000:1.0:1787359949.310812:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359949.310877:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef36f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3f0 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.310898:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359949.310909:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359949.311278:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.311294:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.311317:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.311345:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.311353:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.311360:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.312511:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787359949.312521:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.312530:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.312536:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.312542:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.312546:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.312553:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.312563:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336800) 00010000:00010000:1.0:1787359949.312566:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.312574:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.312580:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3818 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787359949.312595:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a96bad29 reply state 000000005c1fb190 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359949.312603:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787359949.312713:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9682:x1874182508921344:12345-192.168.201.14@tcp:36:mkdir.0 Request processed in 1956us (2306us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787359949.312721:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00010000:00010000:3.0:1787359949.320217:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.320238:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.320247:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.320253:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359949.320258:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.320285:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.320310:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff983d20336200) 00010000:00010000:3.0:1787359949.320313:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359949.320318:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.320324:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef381f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359949.324595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.324648:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508921472 00000100:00100000:1.0:1787359949.324670:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508921472 00000100:00100000:1.0:1787359949.324870:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787359949.324881:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:9683:x1874182508921472:12345-192.168.201.14@tcp:101:chmod.0 00010000:00010000:1.0:1787359949.324906:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359949.324942:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce475 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.325021:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef382d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.325038:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef382d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.325051:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef382d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.325124:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787359949.325152:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359949.325201:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef382d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.325233:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce475 expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.325252:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef382d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce475 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.325262:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787359949.325265:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787359949.325269:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3400, rc 0) 00000100:00100000:1.0:1787359949.325340:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9683:x1874182508921472:12345-192.168.201.14@tcp:101:chmod.0 Request processed in 460us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.325347:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787359949.331826:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.332348:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508921728 00000100:00100000:1.0:1787359949.332361:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508921728 00000100:00100000:1.0:1787359949.332441:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:1.0:1787359949.332455:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9683:x1874182508921728:12345-192.168.201.14@tcp:36:chmod.0 00010000:00010000:1.0:1787359949.332518:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359949.332551:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef382d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce475 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.332585:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787359949.332597:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359949.332627:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.332672:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.332733:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787359949.333102:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c68fc1c5 reply state 000000004e697211 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359949.333113:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787359949.333127:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787359949.333232:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:9683:x1874182508921728:12345-192.168.201.14@tcp:36:chmod.0 Request processed in 780us (1416us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787359949.333241:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00010000:00010000:1.0:1787359949.337158:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.337177:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.337186:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.337193:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.337198:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.337207:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.337228:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336800) 00010000:00010000:1.0:1787359949.337244:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787359949.337250:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.337257:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3834 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359949.364454:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.364631:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508921856 00000100:00100000:3.0:1787359949.364643:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508921856 00000100:00100000:3.0:1787359949.364721:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:3.0:1787359949.364732:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9684:x1874182508921856:12345-192.168.201.14@tcp:101:chown.0 00010000:00010000:3.0:1787359949.364755:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359949.364778:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef383b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce47c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.364842:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3842 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.364854:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.364863:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359949.364920:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787359949.364937:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359949.364985:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.365017:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef383b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce47c expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.365030:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3842 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce47c expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.365037:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d0947cd00) 00010000:00010000:3.0:1787359949.365039:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787359949.365042:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62000, rc 0) 00000100:00100000:3.0:1787359949.365108:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:9684:x1874182508921856:12345-192.168.201.14@tcp:101:chown.0 Request processed in 377us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359949.365116:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:2.0:1787359949.367391:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.367536:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508921984 00000100:00100000:1.0:1787359949.367546:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508921984 00000100:00100000:1.0:1787359949.367619:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:1.0:1787359949.367629:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:9684:x1874182508921984:12345-192.168.201.14@tcp:101:chown.0 00010000:00010000:1.0:1787359949.367668:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359949.367714:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce483 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367770:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367782:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367791:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367801:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367806:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367810:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367914:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef385e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367920:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef385e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.367927:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef385e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.367965:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787359949.367970:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359949.367993:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef385e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368003:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368008:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368015:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368021:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.368026:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368034:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368047:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d0947cd00) 00010000:00010000:1.0:1787359949.368055:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.368062:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368067:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368076:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368080:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368084:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368096:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.368098:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368102:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368107:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff983d20336800) 00010000:00010000:1.0:1787359949.368108:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.368110:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368114:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef3857 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368156:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce483 expref: 10 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368181:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef385e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce483 expref: 9 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.368190:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787359949.368191:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787359949.368193:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3600, rc 0) 00000100:00100000:1.0:1787359949.368241:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:9684:x1874182508921984:12345-192.168.201.14@tcp:101:chown.0 Request processed in 613us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.368246:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:2.0:1787359949.372956:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.373611:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508922240 00000100:00100000:3.0:1787359949.373625:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508922240 00000100:00100000:2.0:1787359949.373793:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:2.0:1787359949.373807:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:9684:x1874182508922240:12345-192.168.201.14@tcp:36:chown.0 00010000:00010000:2.0:1787359949.373867:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359949.373902:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef385e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce483 expref: 9 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.373924:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336700) 00010000:00010000:2.0:1787359949.373936:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787359949.373965:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.373995:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.374061:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787359949.398672:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1787359949.398711:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787359949.399216:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004977dc8e reply state 000000003668ade4 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359949.399231:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787359949.399389:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787359949.399614:0:5863:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787359949.399639:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9684:x1874182508922240:12345-192.168.201.14@tcp:36:chown.0 Request processed in 25831us (26688us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787359949.399649:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00010000:00010000:3.0:1787359949.399754:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.399765:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.399773:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.399780:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359949.399786:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.399805:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.399826:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d25919a00) 00010000:00010000:3.0:1787359949.399829:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787359949.399835:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.399842:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3865 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359949.414236:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.414557:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508922368 00000100:00100000:3.0:1787359949.414581:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508922368 00000100:00100000:3.0:1787359949.414655:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:3.0:1787359949.414667:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:9685:x1874182508922368:12345-192.168.201.14@tcp:101:touch.500 00010000:00010000:3.0:1787359949.414739:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359949.414763:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef386c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce48a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787359949.418356:0:5861:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3536us 00010000:00010000:1.0:1787359949.432156:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432183:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432196:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432226:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432233:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432239:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432706:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432715:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432723:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.432804:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787359949.432808:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359949.432900:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432914:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432921:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432928:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432944:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.432949:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432957:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432972:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d0947cd00) 00010000:00010000:1.0:1787359949.432975:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.432981:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.432988:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433012:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433019:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433026:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433032:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.433035:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433041:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433060:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff983d20336800) 00010000:00010000:1.0:1787359949.433063:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.433066:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433071:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef387a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433115:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef386c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce48a expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433142:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce48a expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.433151:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359949.433153:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787359949.433156:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3400, rc 0) 00000100:00100000:1.0:1787359949.433293:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9685:x1874182508922368:12345-192.168.201.14@tcp:101:touch.500 Request processed in 18627us (19065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.433303:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:3.0:1787359949.438009:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359949.438092:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508922624 00000100:00100000:0.0:1787359949.438105:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508922624 00000100:00100000:0.0:1787359949.438184:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:0.0:1787359949.438196:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9685:x1874182508922624:12345-192.168.201.14@tcp:101:touch.500 00010000:00010000:0.0:1787359949.438218:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359949.438247:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3888 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce491 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.438586:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.438602:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.438615:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.438631:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.438652:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.438660:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787359949.439453:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787359949.439670:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef389d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439711:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439731:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439760:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439767:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439775:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439781:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359949.439787:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439796:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439820:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359949.439823:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359949.439828:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439836:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef388f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787359949.439850:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a64eb885 reply state 00000000fa3277a3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359949.439860:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787359949.439894:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3888 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce491 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439910:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef389d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce491 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.439919:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d09750300) 00010000:00010000:0.0:1787359949.439921:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787359949.439924:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40400, rc 0) 00000100:00100000:0.0:1787359949.440459:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:9685:x1874182508922624:12345-192.168.201.14@tcp:101:touch.500 Request processed in 2263us (2466us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787359949.440468:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 22 00010000:00010000:2.0:1787359949.442580:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.442595:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.442603:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.442609:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359949.442613:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.442621:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.442638:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff983d09750b00) 00010000:00010000:2.0:1787359949.442641:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359949.442646:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.442653:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41600/0x72f6de40e4ef3896 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359949.443247:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.443288:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508922880 00000100:00100000:1.0:1787359949.443301:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508922880 00000100:00100000:1.0:1787359949.443358:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:1.0:1787359949.443371:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:9685:x1874182508922880:12345-192.168.201.14@tcp:36:touch.500 00010000:00010000:1.0:1787359949.443431:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359949.443448:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef389d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce491 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.443473:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d09750300) 00010000:00010000:1.0:1787359949.443480:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359949.443526:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.443539:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.443547:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787359949.443768:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000205f8105 reply state 00000000c1325e5c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359949.443778:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787359949.443863:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:9685:x1874182508922880:12345-192.168.201.14@tcp:36:touch.500 Request processed in 495us (617us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787359949.443871:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 23 00010000:00010000:1.0:1787359949.444816:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.444826:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.444832:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.444837:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.444841:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.444856:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.444866:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d20336f00) 00010000:00010000:1.0:1787359949.444869:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.444873:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.444879:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359949.446047:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.446101:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508923008 00000100:00100000:1.0:1787359949.446112:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508923008 00000100:00100000:1.0:1787359949.446178:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 24 00000100:00100000:1.0:1787359949.446189:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:9685:x1874182508923008:12345-192.168.201.14@tcp:101:touch.500 00010000:00010000:1.0:1787359949.446211:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359949.446233:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3c00/0x72f6de40e4ef38b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce498 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.446292:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3c00/0x72f6de40e4ef38b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce498 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.446306:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3c00/0x72f6de40e4ef38b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce498 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.446325:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787359949.446328:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787359949.446331:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3c00, rc 0) 00000100:00100000:1.0:1787359949.446399:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:9685:x1874182508923008:12345-192.168.201.14@tcp:101:touch.500 Request processed in 212us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.446407:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 24 00000100:00100000:3.0:1787359949.448483:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.449340:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508923136 00000100:00100000:1.0:1787359949.449353:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508923136 00000100:00100000:1.0:1787359949.449406:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787359949.449417:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874182508923136:12345-192.168.201.14@tcp:8:touch.500 00010000:00080000:1.0:1787359949.449453:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:1.0:1787359949.449484:0:6698:0:(genops.c:1385:class_connect()) connect: client 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430, cookie 0x72f6de40e4ef38b9 00002000:00100000:1.0:1787359949.449495:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430/ffff983d407f9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787359949.449506:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787359949.449767:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787359949.449805:0:6698:0:(import.c:65:import_set_state_nolock()) ffff983d407ff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787359949.449887:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2361:x1874182508923136:12345-192.168.201.14@tcp:8:touch.500 Request processed in 470us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.449896:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787359949.453361:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.453447:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508923264 00000100:00100000:1.0:1787359949.453458:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508923264 00000100:00100000:1.0:1787359949.453531:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:1.0:1787359949.453542:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:0:x1874182508923264:12345-192.168.201.14@tcp:2:touch.500 00000100:00080000:0.0:1787359949.455110:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787359949.474990:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787359949.475006:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000100:00100000:0.0:1787359949.475117:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:0:x1874182508923264:12345-192.168.201.14@tcp:2:touch.500 Request processed in 21569us (21757us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787359949.475129:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:2.0:1787359949.476833:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359949.476890:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508923520 00000100:00100000:0.0:1787359949.476900:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508923520 00000100:00100000:0.0:1787359949.476949:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:0.0:1787359949.476957:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:9685:x1874182508923520:12345-192.168.201.14@tcp:35:touch.500 00000100:00100000:0.0:1787359949.477404:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:9685:x1874182508923520:12345-192.168.201.14@tcp:35:touch.500 Request processed in 444us (574us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787359949.477413:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:3.0:1787359949.489422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.489539:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508923648 00000100:00100000:1.0:1787359949.489554:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508923648 00000100:00100000:1.0:1787359949.489637:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:1.0:1787359949.489649:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:9686:x1874182508923648:12345-192.168.201.14@tcp:101:rm.0 00010000:00010000:1.0:1787359949.489818:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359949.489856:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce49f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.489930:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef38c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.489946:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef38c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.489958:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef38c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.490032:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787359949.490037:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359949.490099:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef38c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.490128:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef38c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce49f expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.490158:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef38c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce49f expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.490170:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359949.490173:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787359949.490177:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2200, rc 0) 00000100:00100000:1.0:1787359949.490248:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:9686:x1874182508923648:12345-192.168.201.14@tcp:101:rm.0 Request processed in 601us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.490255:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:2.0:1787359949.494617:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359949.495117:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508923904 00000100:00100000:0.0:1787359949.495129:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508923904 00000100:00100000:0.0:1787359949.495251:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:0.0:1787359949.495264:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:9686:x1874182508923904:12345-192.168.201.14@tcp:101:rm.0 00010000:00010000:0.0:1787359949.495289:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359949.495312:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef38ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4a6 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359949.495442:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787359949.495627:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef38ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4a6 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.495646:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d0947cd00) 00010000:00010000:0.0:1787359949.495649:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787359949.495655:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef38ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4a6 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359949.495855:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787359949.495975:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:9686:x1874182508923904:12345-192.168.201.14@tcp:101:rm.0 Request processed in 714us (1369us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787359949.495994:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:3.0:1787359949.500472:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.500562:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508924032 00000100:00100000:1.0:1787359949.500600:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508924032 00000100:00100000:1.0:1787359949.500699:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:1.0:1787359949.500713:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:9686:x1874182508924032:12345-192.168.201.14@tcp:37:rm.0 00000100:00100000:1.0:1787359949.504891:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:9686:x1874182508924032:12345-192.168.201.14@tcp:37:rm.0 Request processed in 4167us (4416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.504904:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:2.0:1787359949.509526:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.509658:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508924288 00000100:00100000:3.0:1787359949.509826:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508924288 00000100:00100000:3.0:1787359949.509887:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:3.0:1787359949.509899:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d11139050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:9686:x1874182508924288:12345-192.168.201.14@tcp:35:rm.0 00000100:00100000:3.0:1787359949.510333:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d11139050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:9686:x1874182508924288:12345-192.168.201.14@tcp:35:rm.0 Request processed in 433us (815us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787359949.510341:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787359949.514562:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.514920:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508924544 00000100:00100000:1.0:1787359949.514931:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508924544 00000100:00100000:1.0:1787359949.515078:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:1.0:1787359949.515091:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:9686:x1874182508924544:12345-192.168.201.14@tcp:101:rm.0 00010000:00010000:1.0:1787359949.515117:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359949.515147:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef38dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4ad expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.515272:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef38e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.515285:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef38e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.515296:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef38e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.515306:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787359949.515428:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef38dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4ad expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.515445:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef38e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4ad expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.515472:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359949.515475:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787359949.515478:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2400, rc 0) 00000100:00100000:1.0:1787359949.515546:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508924544:12345-192.168.201.14@tcp:101:rm.0 Request processed in 458us (993us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787359949.515554:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:1.0:1787359949.521348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.521436:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508924672 00000100:00100000:3.0:1787359949.521449:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508924672 00000100:00100000:3.0:1787359949.521515:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 28 00000100:00100000:3.0:1787359949.521526:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508924672:12345-192.168.201.14@tcp:41:rm.0 00000004:00000024:3.0:1787359949.521591:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7718567936 avail 7714373632 00000100:00100000:3.0:1787359949.521668:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508924672:12345-192.168.201.14@tcp:41:rm.0 Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359949.521674:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 28 00000100:00100000:3.0:1787359949.523527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359949.523620:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508924800 00000100:00100000:2.0:1787359949.523630:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508924800 00000100:00100000:2.0:1787359949.523824:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:2.0:1787359949.523835:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508924800:12345-192.168.201.14@tcp:101:rm.0 00010000:00010000:2.0:1787359949.523855:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359949.523881:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef38f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4b4 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.523951:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.523968:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.523979:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.523996:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524206:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524218:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524351:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524361:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524368:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359949.524397:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787359949.524402:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787359949.524424:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524436:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524444:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524450:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524456:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524462:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359949.524466:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524474:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524496:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787359949.524499:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359949.524506:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524513:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef38f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524526:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524531:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524537:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524542:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359949.524545:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524550:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524557:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff983d25919b00) 00010000:00010000:2.0:1787359949.524559:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359949.524562:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524567:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef38ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524612:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef38f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4b4 expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524627:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4b4 expref: 17 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.524634:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d20336700) 00010000:00010000:2.0:1787359949.524636:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359949.524639:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346000, rc 0) 00000100:00100000:2.0:1787359949.524837:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:9686:x1874182508924800:12345-192.168.201.14@tcp:101:rm.0 Request processed in 1002us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359949.524845:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:2.0:1787359949.528437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359949.528521:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508925056 00000100:00100000:3.0:1787359949.528534:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508925056 00000100:00100000:3.0:1787359949.528609:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:3.0:1787359949.528620:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:9686:x1874182508925056:12345-192.168.201.14@tcp:36:rm.0 00010000:00010000:3.0:1787359949.528730:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787359949.528761:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef3906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4b4 expref: 17 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528785:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3c00/0x72f6de40e4ef38b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce498 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528818:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d20336700) 00010000:00010000:3.0:1787359949.528837:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2200/0x72f6de40e4ef38c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce49f expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528848:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359949.528851:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359949.528874:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528887:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528897:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528912:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528919:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.528926:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529087:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529095:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529114:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787359949.529846:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787359949.529859:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323858181161ns, next at 324858178591ns, rc = 0 00010000:00010000:3.0:1787359949.529924:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529935:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529946:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529953:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529960:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529966:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.529982:0:5863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787359949.530002:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530009:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530016:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530029:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359949.530034:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530042:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530052:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d0947c100) 00010000:00010000:3.0:1787359949.530055:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787359949.530059:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530065:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef391b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530082:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530088:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530095:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530099:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359949.530102:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530107:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530125:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359949.530127:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359949.530130:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359949.530150:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62c00/0x72f6de40e4ef390d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787359949.530161:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053ba5b0d reply state 000000002989cae4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359949.530170:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787359949.530263:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508925056:12345-192.168.201.14@tcp:36:rm.0 Request processed in 1642us (1833us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787359949.530272:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 30 00010000:00010000:1.0:1787359949.530771:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359949.530779:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.530785:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359949.530790:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.530797:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.530806:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff983d0947c100) 00010000:00010000:1.0:1787359949.530809:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787359949.530812:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.530816:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3922 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.530831:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359949.530833:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359949.530835:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359949.532901:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.532918:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.532927:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.532933:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359949.532937:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.532946:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.532981:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff983d0947c200) 00010000:00010000:2.0:1787359949.532985:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359949.532989:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359949.532997:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3914 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359949.535477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.535544:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508925312 00000100:00100000:1.0:1787359949.535556:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508925312 00000100:00100000:1.0:1787359949.535628:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:1.0:1787359949.535641:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:9686:x1874182508925312:12345-192.168.201.14@tcp:35:rm.0 00000100:00100000:1.0:1787359949.535957:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508925312:12345-192.168.201.14@tcp:35:rm.0 Request processed in 318us (487us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787359949.535963:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:3.0:1787359949.538331:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359949.538416:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508925568 00000100:00100000:1.0:1787359949.538427:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508925568 00000100:00100000:1.0:1787359949.538487:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:1.0:1787359949.538498:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:9686:x1874182508925568:12345-192.168.201.14@tcp:36:rm.0 00010000:00010000:1.0:1787359949.538555:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787359949.538596:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef38e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4ad expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538619:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce48a expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538632:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359949.538648:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3842 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce47c expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538657:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d0947cd00) 00010000:00010000:1.0:1787359949.538704:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359949.538734:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538749:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538773:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538787:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538794:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.538800:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539118:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539127:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539145:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359949.539765:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787359949.539780:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539788:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539794:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539801:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.539812:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539820:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539831:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787359949.539834:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787359949.539839:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539845:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3937 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539864:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539871:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539877:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539882:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.539885:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539891:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539898:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336f00) 00010000:00010000:1.0:1787359949.539900:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.539910:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.539916:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3929 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787359949.539928:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8a5aa7c reply state 00000000bd986040 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359949.539937:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787359949.540022:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:9686:x1874182508925568:12345-192.168.201.14@tcp:36:rm.0 Request processed in 1522us (1698us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787359949.540031:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 31 00010000:00010000:1.0:1787359949.542914:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.542933:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.542941:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.542946:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359949.542951:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.542959:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.542977:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff983d20336800) 00010000:00010000:1.0:1787359949.542980:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359949.542985:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359949.543014:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3930 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359949.735050:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359949.735075:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527832704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787359949.735162:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359949.735482:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832704 00000100:00100000:1.0:1787359949.735492:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832704 00000100:00100000:1.0:1787359949.735569:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787359949.735581:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527832704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787359949.735620:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787359949.735759:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527832704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359949.735767:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787359949.735854:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f8cd500 x1874182527832704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359949.735874:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527832704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787359949.736003:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359949.862874:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359950.893419:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359951.910887:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359951.948123:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359951.948659:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508925824 00000100:00100000:1.0:1787359951.948718:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508925824 00000100:00100000:1.0:1787359951.948811:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00100000:1.0:1787359951.948823:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:2363:x1874182508925824:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359951.948931:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:2363:x1874182508925824:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 109us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359951.948940:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00080000:0.0:1787359951.949115:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359951.956075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359951.956134:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359951.956400:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508925952 00000100:00100000:1.0:1787359951.956411:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508925952 00000100:00100000:1.0:1787359951.956500:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:1.0:1787359951.956513:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2362:x1874182508925952:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359951.956605:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2362:x1874182508925952:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 95us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359951.956637:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00080000:0.0:1787359951.956844:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787359951.956984:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508925696 00000100:00100000:3.0:1787359951.956990:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508925696 00000100:00100000:3.0:1787359951.957035:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 248 00000100:00100000:3.0:1787359951.957044:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508925696:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359951.957079:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508925696:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 36us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359951.957086:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 248 00000100:00100000:2.0:1787359951.958446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359951.958569:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926080 00000100:00100000:1.0:1787359951.958577:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926080 00000100:00100000:1.0:1787359951.958642:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 100 00000100:00100000:1.0:1787359951.958652:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508926080:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359951.958756:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508926080:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359951.958764:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 100 00000100:00080000:0.0:1787359951.958870:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359952.295704:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527832832:0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.295767:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527832960:0@lo:400:kworker.0 00000100:00100000:2.0:1787359952.295865:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527833088:0@lo:400:kworker.0 00000100:00100000:0.0:1787359952.296058:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527833216:0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.299252:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359952.299350:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527833472:0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.299391:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359952.299467:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527833472 00000100:00100000:1.0:1787359952.299476:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527833472 00000100:00100000:1.0:1787359952.299550:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787359952.299562:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527833472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.299625:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527833472:12345-0@lo:400:kworker.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.299633:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787359952.299656:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787359952.299674:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832960 00000100:00100000:1.0:1787359952.299697:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832960 00000100:00100000:1.0:1787359952.299736:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787359952.299744:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527832960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.299809:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527832960:12345-0@lo:400:kworker.0 Request processed in 65us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.299823:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787359952.299871:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527832960:0@lo:400:kworker.0 00010000:00080000:1.0:1787359952.299886:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a20c000 x1874182527833472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359952.299896:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527833472:0@lo:400:kworker.0 00000100:00100000:3.0:1787359952.301649:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359952.301945:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527833344:0@lo:400:kworker.0 00000100:00100000:3.0:1787359952.302016:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359952.302215:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527832832 00000100:00100000:1.0:1787359952.302223:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527832832 00000100:00100000:1.0:1787359952.302285:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787359952.302296:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527832832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.302364:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527832832:12345-0@lo:400:kworker.0 Request processed in 70us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.302373:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787359952.302409:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527833344 00000100:00100000:1.0:1787359952.302413:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527833344 00000100:00100000:1.0:1787359952.302454:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787359952.302461:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527833344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.302495:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527833344:12345-0@lo:400:kworker.0 Request processed in 35us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.302502:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787359952.302521:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359952.302555:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527832832:0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.302572:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527833344:0@lo:400:kworker.0 00000100:00100000:2.0:1787359952.305004:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359952.305493:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359952.305924:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527833216 00000100:00100000:2.0:1787359952.305937:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527833216 00000100:00100000:2.0:1787359952.306029:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787359952.306041:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527833216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359952.306120:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527833216:12345-0@lo:400:kworker.0 Request processed in 82us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359952.306129:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787359952.306221:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359952.306511:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527833088 00000100:00100000:1.0:1787359952.306517:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527833088 00000100:00080000:3.0:1787359952.306645:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359952.306701:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787359952.306711:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527833088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359952.306788:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527833088:12345-0@lo:400:kworker.0 Request processed in 80us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359952.306795:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787359952.306878:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527833088:0@lo:400:kworker.0 00010000:00080000:0.0:1787359952.311935:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a20ea00 x1874182527833216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359952.311961:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527833216:0@lo:400:kworker.0 00000004:00080000:3.0:1787359952.808286:0:8021:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327136604866ns, next at 328136601556ns, rc = 0 00000100:00100000:3.0:1787359952.808329:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527833600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359952.808418:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359952.811225:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527833600 00000100:00100000:3.0:1787359952.811239:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527833600 00000100:00100000:3.0:1787359952.811295:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787359952.811306:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527833600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787359952.811352:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359952.811431:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527833600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359952.811439:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787359952.811486:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ce00 x1874182527833600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359952.811509:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527833600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359952.938280:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787359953.617864:0:11623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787359953.958911:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787359954.760639:0:11671:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe84615380 20000000:00000080:1.0:1787359954.760657:0:11671:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983d3f1f6000 uarg=0000000000000000 20000000:01000000:1.0:1787359954.761086:0:11671:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787359954.761094:0:11671:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787359954.761100:0:11671:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787359954.764363:0:11672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787359954.764621:0:11671:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787359954.770517:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787359954.770591:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787359954.770657:0:11671:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787359954.770706:0:11671:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787359954.770730:0:11671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770750:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770757:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770764:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770774:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770798:0:11671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770806:0:11671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770854:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.770870:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 12 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.770886:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527833728:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359954.770998:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771006:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 12 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771015:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527833856:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359954.771060:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771069:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 18 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771078:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527833984:0@lo:104: 00000100:00100000:1.0:1787359954.771119:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359954.771173:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527833984 00000100:00100000:1.0:1787359954.771182:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527833984 00000100:00100000:1.0:1787359954.771245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787359954.771256:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11671:x1874182527833984:12345-0@lo:104: 00010000:00010000:1.0:1787359954.771270:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771329:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359954.771335:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11671:x1874182527833984:12345-0@lo:104: Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359954.771343:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787359954.771383:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771392:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771400:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527834112:0@lo:104: 00010000:00010000:2.0:1787359954.771420:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787359954.771423:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787359954.771428:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.771437:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc1cc3c20) 00000100:00100000:1.0:1787359954.771443:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834112 00000100:00100000:1.0:1787359954.771446:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834112 10000000:00010000:2.0:1787359954.771449:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.771458:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787359954.771466:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771470:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 10000000:01000000:2.0:1787359954.771473:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787359954.771476:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11671:x1874182527834112:12345-0@lo:104: 00010000:00010000:1.0:1787359954.771483:0:7638:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771514:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787359954.771517:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771519:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11671:x1874182527834112:12345-0@lo:104: Request processed in 44us (96us total) trans 0 rc 0/0 00010000:00010000:2.0:1787359954.771525:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787359954.771533:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787359954.771546:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771547:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359954.771552:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.771553:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41a00/0x72f6de40e4ef37fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef3803 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771558:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787359954.771561:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771568:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787359954.771574:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.771580:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787359954.771580:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787359954.771582:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359954.771584:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359954.771594:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771599:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787359954.771603:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527834240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359954.771613:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771619:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165a400/0x72f6de40e4ef37ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37f5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771628:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359954.771630:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359954.771632:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787359954.771632:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359954.771641:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527834368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787359954.771669:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787359954.771749:0:11671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771757:0:11671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 18 pid: 5853 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359954.771759:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834240 00000100:00100000:2.0:1787359954.771762:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834240 00000100:00100000:1.0:1787359954.771765:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527834496:0@lo:104: 00010000:00010000:2.0:1787359954.771784:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 19 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771790:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359954.771802:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834368 00000100:00100000:2.0:1787359954.771811:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834368 00000100:00100000:1.0:1787359954.771813:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787359954.771822:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834496 00010000:00010000:2.0:1787359954.771825:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 20 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771825:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834496 00000100:00100000:1.0:1787359954.771843:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787359954.771849:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39f18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11671:x1874182527834496:12345-0@lo:104: 00000100:00100000:2.0:1787359954.771854:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787359954.771857:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359954.771860:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3318:x1874182527834240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787359954.771870:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359954.771875:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 20 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.771884:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 20 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359954.771885:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787359954.771890:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39f18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+3:11671:x1874182527834496:12345-0@lo:104: Request processed in 42us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359954.771895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787359954.771900:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359954.771923:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3318:x1874182527834240:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359954.771929:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787359954.771932:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12ef66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359954.771942:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787359954.771947:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527834368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787359954.771953:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef3803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef37fc expref: 19 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359954.771962:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527833984:0@lo:104: 00000100:00100000:1.0:1787359954.771972:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527834112:0@lo:104: 00000100:00100000:1.0:1787359954.771977:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527834496:0@lo:104: 00010000:00010000:2.0:1787359954.772096:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359954.772102:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.772111:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.772121:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165ba00/0x72f6de40e4ef37f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef37ee expref: 18 pid: 5855 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.772129:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359954.772167:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3319:x1874182527834368:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359954.772174:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787359954.772203:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527834240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787359954.772857:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359954.772865:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.772872:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787359954.772877:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.772883:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787359954.772890:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359954.772905:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787359954.772951:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.772957:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787359954.772974:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.772981:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef37e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef37e7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.772995:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359954.772996:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359954.772998:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359954.773010:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527834624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787359954.773067:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359954.773152:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834624 00000100:00100000:2.0:1787359954.773160:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834624 00010000:00010000:2.0:1787359954.773183:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 17 pid: 5853 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359954.773216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787359954.773225:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3320:x1874182527834624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787359954.773235:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359954.773240:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 17 pid: 5853 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.773250:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 17 pid: 5853 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.773263:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165bc00/0x72f6de40e4ef37e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef37e0 expref: 17 pid: 5853 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.773273:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359954.773324:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3320:x1874182527834624:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359954.773330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787359954.775875:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527834624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359954.776916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359954.776939:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527834368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787359954.776944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359954.777065:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527833728:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787359954.777076:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11671:1874182527833856:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359954.777124:0:11671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359954.777222:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926208 00000100:00100000:0.0:1787359954.777230:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926208 00010000:00010000:0.0:1787359954.777269:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 13 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359954.777314:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926336 00000100:00100000:0.0:1787359954.777318:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926336 00010000:00010000:0.0:1787359954.777332:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 14 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359954.777359:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:0.0:1787359954.777421:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+14:2362:x1874182508926208:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359954.777438:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359954.777445:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 14 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359954.777446:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:2.0:1787359954.777455:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+14:2362:x1874182508926336:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359954.777459:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 14 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.777469:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359954.777473:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 14 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.777478:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c2800/0x72f6de40e4ef3811 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce46e expref: 14 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.777481:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 14 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.777490:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef380a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce467 expref: 13 pid: 5853 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.777497:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.777505:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.779636:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359954.779836:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+12:2362:x1874182508926336:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 2367us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359954.779849:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 34 00010000:00010000:0.0:1787359954.781362:0:8457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781378:0:8457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781386:0:8457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781393:0:8457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781399:0:8457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787359954.781404:0:8457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781482:0:8457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781502:0:8457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359954.781515:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359954.781586:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+11:2362:x1874182508926208:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 4172us (4672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359954.781596:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 33 00010000:00010000:3.0:1787359954.781735:0:11671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359954.781743:0:11671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359954.781750:0:11671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c2000/0x72f6de40e4ef393e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359954.856326:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527834752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359954.856405:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359954.856476:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834752 00000100:00100000:2.0:1787359954.856485:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834752 00000100:00100000:2.0:1787359954.856549:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787359954.856559:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527834752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359954.856596:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787359954.856643:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527834752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359954.856651:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787359954.856672:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359954.856729:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983c0369ce00 x1874182527834752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359954.856746:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527834752:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787359954.923454:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:0.0:1787359954.923479:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787359954.923492:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787359954.923511:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787359954.923733:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787359954.923759:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527834880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787359954.923831:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359954.923937:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527834880 00000100:00100000:2.0:1787359954.923947:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527834880 00000100:00100000:2.0:1787359954.924027:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787359954.924037:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527834880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787359954.924079:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787359954.924116:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a88f2cc, atime: 0x6a88f2cc, ctime: 0x6a88f2cc, blocks: 0x1 00010000:00010000:2.0:1787359954.924127:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924147:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1787359954.924152:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787359954.924159:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924180:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924193:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924202:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924220:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787359954.924784:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527834880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 746us (951us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787359954.924794:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787359954.924824:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787359954.924831:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924845:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787359954.924850:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924875:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924898:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924907:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079915625/0x72f6de40e4ef3945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359954.924925:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359954.924927:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359954.924929:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787359954.924967:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f8e3b80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787359954.924974:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527834880:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1787359954.925051:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787359954.983066:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359956.006920:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787359956.262832:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787359956.262840:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d11588000 from 7 10000000:01000000:2.0:1787359956.262845:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787359956.262903:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359956.262915:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359956.262952:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359956.262978:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.263063:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.263138:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48300 going to sleep for 11 seconds 00000100:00100000:1.0:1787359956.263232:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835008 00000100:00100000:1.0:1787359956.263242:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835008 00000100:00100000:1.0:1787359956.263317:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787359956.263327:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:5858:x1874182527835008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359956.263341:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359956.263355:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef3953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef394c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.263381:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef394c expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.263392:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef394c expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.263404:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2200, rc 0) 00000100:00100000:1.0:1787359956.263456:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527835008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359956.263463:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787359956.263891:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359956.263909:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359956.263919:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359956.263985:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.264015:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.264057:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.266888:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835136 00000100:00100000:3.0:1787359956.266905:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835136 00000100:00100000:3.0:1787359956.266987:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787359956.267000:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527835136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359956.267355:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527835136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359956.267364:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787359956.268826:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.268903:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.268970:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.269031:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48300 going to sleep for 11 seconds 00000100:00100000:0.0:1787359956.269117:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835264 00000100:00100000:0.0:1787359956.269125:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835264 00000100:00100000:0.0:1787359956.269191:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787359956.269203:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527835264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.269399:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527835264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.269408:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787359956.270041:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.270751:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11686:1874182527835392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359956.270812:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.270851:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48240 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.271006:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835392 00000100:00100000:3.0:1787359956.271013:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835392 00000100:00100000:3.0:1787359956.271066:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787359956.271077:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:11686:x1874182527835392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359956.271309:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+17:11686:x1874182527835392:12345-0@lo:502:llog_process_th.0 Request processed in 233us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359956.271319:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787359956.271729:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11686:1874182527835392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787359956.271758:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787359956.271767:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787359956.271769:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787359956.271776:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff983d11588000 00000020:00000080:2.0:1787359956.271778:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787359956.271866:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11686:1874182527835520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787359956.271905:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.271941:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359956.274867:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835520 00000100:00100000:0.0:1787359956.274880:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835520 00000100:00100000:0.0:1787359956.274931:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787359956.274942:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:11686:x1874182527835520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359956.275250:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+17:11686:x1874182527835520:12345-0@lo:502:llog_process_th.0 Request processed in 308us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.275263:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787359956.275265:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11686:1874182527835520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787359956.275310:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359956.275317:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359956.275320:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787359956.275325:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787359956.282584:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787359956.282624:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359956.282638:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.282652:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359956.282664:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787359956.282666:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d200eb000 from 7 10000000:01000000:0.0:1787359956.282669:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359956.282761:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.282770:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.282782:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359956.282810:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.282884:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359956.282937:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f5d20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.283198:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835648 00000100:00100000:3.0:1787359956.283208:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835648 00000100:00100000:3.0:1787359956.283276:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787359956.283287:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:5858:x1874182527835648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359956.283302:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359956.283318:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef3961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef395a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359956.283348:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef3961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef395a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359956.283361:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef3961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef395a expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359956.283371:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62c00, rc 0) 00000100:00100000:3.0:1787359956.283427:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2015f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527835648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359956.283434:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787359956.283518:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787359956.283535:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359956.283545:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359956.283604:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.283635:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.283661:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48840 going to sleep for 11 seconds 00000100:00100000:0.0:1787359956.283738:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835776 00000100:00100000:0.0:1787359956.283742:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835776 00000100:00100000:0.0:1787359956.283775:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787359956.283783:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527835776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.284047:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527835776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.284061:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787359956.284180:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.284213:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.284253:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359956.291342:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32c48840 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.293149:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527835904 00000100:00100000:3.0:1787359956.293165:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527835904 00000100:00100000:3.0:1787359956.293232:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787359956.293246:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527835904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359956.293493:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527835904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (9238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359956.293508:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787359956.293580:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527835904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787359956.294966:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11689:1874182527836032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359956.295043:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359956.295954:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836032 00000100:00100000:1.0:1787359956.295966:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836032 00000100:00100000:1.0:1787359956.296035:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787359956.296046:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:11689:x1874182527836032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359956.296306:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:11689:x1874182527836032:12345-0@lo:502:llog_process_th.0 Request processed in 261us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359956.296315:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787359956.301749:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1055f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.301826:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11689:1874182527836032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787359956.301878:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787359956.301890:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359956.301892:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787359956.301900:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff983d200eb000 00000020:00000080:3.0:1787359956.301903:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787359956.302007:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11689:1874182527836160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787359956.302101:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359956.302250:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1055f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787359956.302787:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836160 00000100:00100000:1.0:1787359956.302796:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836160 00000100:00100000:1.0:1787359956.302856:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787359956.302868:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:11689:x1874182527836160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787359956.303123:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:11689:x1874182527836160:12345-0@lo:502:llog_process_th.0 Request processed in 256us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359956.303132:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787359956.304223:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11689:1874182527836160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787359956.304265:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787359956.304274:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787359956.304276:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787359956.304282:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787359956.304475:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787359956.304503:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359956.304516:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.304527:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787359956.304538:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787359956.304540:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d0dccf000 from 7 10000000:01000000:0.0:1787359956.304543:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787359956.304581:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.304589:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.304599:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359956.304623:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527836288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.304706:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359956.304747:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e258300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.305261:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836288 00000100:00100000:3.0:1787359956.305270:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836288 00000100:00100000:3.0:1787359956.305323:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787359956.305333:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:5858:x1874182527836288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787359956.305346:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359956.305360:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62400/0x72f6de40e4ef396f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef3968 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359956.305398:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62400/0x72f6de40e4ef396f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef3968 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359956.305411:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62400/0x72f6de40e4ef396f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef3968 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359956.305421:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62400, rc 0) 00000100:00100000:3.0:1787359956.305476:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527836288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359956.305483:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787359956.305594:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527836288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359956.305611:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.305620:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359956.305746:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527836416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787359956.305776:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359956.305801:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f2e4300 going to sleep for 11 seconds 00000100:00100000:3.0:1787359956.305870:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836416 00000100:00100000:3.0:1787359956.305875:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836416 00000100:00100000:3.0:1787359956.305904:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787359956.305911:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527836416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787359956.306296:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527836416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359956.306304:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000040:00080000:3.0:1787359956.309574:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787359956.316126:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527836416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.316192:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527836544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.316265:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359956.316304:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e258480 going to sleep for 11 seconds 00000100:00100000:0.0:1787359956.316333:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836544 00000100:00100000:0.0:1787359956.316339:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836544 00000100:00100000:0.0:1787359956.316388:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787359956.316398:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527836544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.316592:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:5858:x1874182527836544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.316601:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787359956.316646:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6055641b-d743-4e3c-a711-70d92fdecc0d:5858:1874182527836544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.316878:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11691:1874182527836672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359956.316911:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359956.316934:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836672 00000100:00100000:0.0:1787359956.316938:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836672 00000100:00100000:0.0:1787359956.316963:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787359956.316970:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:11691:x1874182527836672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359956.317115:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:11691:x1874182527836672:12345-0@lo:502:llog_process_th.0 Request processed in 144us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.317122:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787359956.317153:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359956.317167:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11691:1874182527836672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359956.317187:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787359956.317196:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359956.317198:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787359956.317205:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff983d0dccf000 00000020:00000080:0.0:1787359956.317208:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787359956.317268:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11691:1874182527836800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359956.317303:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359956.317328:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836800 00000100:00100000:0.0:1787359956.317332:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836800 00000100:00100000:0.0:1787359956.317353:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787359956.317359:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:11691:x1874182527836800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787359956.317463:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:11691:x1874182527836800:12345-0@lo:502:llog_process_th.0 Request processed in 103us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.317469:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787359956.317496:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e258300 going to sleep for 11 seconds 00000100:00100000:0.0:1787359956.317507:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6055641b-d743-4e3c-a711-70d92fdecc0d:11691:1874182527836800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787359956.317524:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787359956.317529:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787359956.317530:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787359956.317533:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787359956.317582:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787359956.317599:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787359956.317611:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.317623:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359956.361983:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359956.362067:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926464 00000100:00100000:0.0:1787359956.362081:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926464 00000100:00100000:0.0:1787359956.362152:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 265 00000100:00100000:0.0:1787359956.362164:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+11:5603:x1874182508926464:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787359956.362182:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359956.362202:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40c00/0x72f6de40e4ef3976 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4bb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.362249:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40c00/0x72f6de40e4ef3976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4bb expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.362261:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40c00/0x72f6de40e4ef3976 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4bb expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359956.362272:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40c00, rc 0) 00000100:00100000:0.0:1787359956.362327:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508926464:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 164us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.362335:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 265 00000100:00100000:1.0:1787359956.371520:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359956.372835:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926592 00000100:00100000:2.0:1787359956.372849:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926592 00000100:00100000:2.0:1787359956.372938:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 266 00000100:00100000:2.0:1787359956.372950:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508926592:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.373321:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508926592:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 371us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359956.373331:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 266 00000100:00100000:3.0:1787359956.381500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359956.381671:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926720 00000100:00100000:2.0:1787359956.381698:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926720 00000100:00100000:2.0:1787359956.381817:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 267 00000100:00100000:2.0:1787359956.381829:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508926720:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.382086:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508926720:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 257us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359956.382095:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 267 00000100:00100000:3.0:1787359956.385734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359956.386122:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926848 00000100:00100000:0.0:1787359956.386152:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926848 00000100:00100000:0.0:1787359956.386220:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 268 00000100:00100000:0.0:1787359956.386233:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:9956:x1874182508926848:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787359956.386510:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+12:9956:x1874182508926848:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 279us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.386519:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 268 00000100:00100000:3.0:1787359956.394983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359956.395074:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508926976 00000100:00100000:2.0:1787359956.395086:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508926976 00000100:00100000:2.0:1787359956.395154:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 269 00000100:00100000:2.0:1787359956.395166:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:9956:x1874182508926976:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787359956.395444:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+12:9956:x1874182508926976:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 279us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359956.395454:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 269 00000100:00100000:0.0:1787359956.399322:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359956.399450:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927104 00000100:00100000:1.0:1787359956.399463:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927104 00000100:00100000:1.0:1787359956.399535:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 270 00000100:00100000:1.0:1787359956.399549:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+12:5603:x1874182508927104:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787359956.399567:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359956.399599:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c3c00/0x72f6de40e4ef397d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4c2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.399633:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c3c00/0x72f6de40e4ef397d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4c2 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.399645:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c3c00/0x72f6de40e4ef397d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4c2 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359956.399654:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3c00, rc 0) 00000100:00100000:1.0:1787359956.399741:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508927104:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 197us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359956.399749:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 270 00000100:00100000:3.0:1787359956.401912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359956.409733:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927232 00000100:00100000:0.0:1787359956.409751:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927232 00000100:00100000:0.0:1787359956.409831:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 271 00000100:00100000:0.0:1787359956.409845:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508927232:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787359956.410184:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508927232:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 340us (8279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.410193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 271 00000100:00100000:3.0:1787359956.415349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359956.415549:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927360 00000100:00100000:2.0:1787359956.415562:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927360 00000100:00100000:2.0:1787359956.415628:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 272 00000100:00100000:2.0:1787359956.415640:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508927360:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787359956.415952:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:5603:x1874182508927360:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 312us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359956.415971:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 272 00000100:00100000:3.0:1787359956.418203:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359956.418807:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927488 00000100:00100000:0.0:1787359956.418822:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927488 00000100:00100000:0.0:1787359956.418891:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 273 00000100:00100000:0.0:1787359956.418903:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:9959:x1874182508927488:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787359956.419201:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:9959:x1874182508927488:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 299us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359956.419210:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 273 00000100:00100000:3.0:1787359956.426607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359956.426810:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927616 00000100:00100000:1.0:1787359956.426825:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927616 00000100:00100000:1.0:1787359956.426895:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 274 00000100:00100000:1.0:1787359956.426907:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:9959:x1874182508927616:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787359956.427201:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:9959:x1874182508927616:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 295us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359956.427209:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 274 00010000:00010000:2.0:1787359957.035202:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359957.066898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359957.066960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359957.066993:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359957.067035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359957.067071:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927872 00000100:00100000:3.0:1787359957.067085:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927872 00000100:00100000:3.0:1787359957.067144:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928128 00000100:00100000:3.0:1787359957.067148:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928128 00000100:00100000:3.0:1787359957.067173:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 104 00000100:00100000:3.0:1787359957.067199:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508927872:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359957.067279:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508927872:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359957.067287:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 104 00000100:00100000:3.0:1787359957.067308:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 105 00000100:00100000:3.0:1787359957.067315:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508928128:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359957.067339:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508928128:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359957.067345:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 105 00000100:00100000:2.0:1787359957.068351:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928000 00000100:00100000:2.0:1787359957.068360:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928000 00000100:00100000:2.0:1787359957.068417:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:2.0:1787359957.068428:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508928000:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359957.068477:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508928000:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 51us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.068484:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00080000:1.0:1787359957.068968:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359957.068974:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359957.069168:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508927744 00000100:00100000:0.0:1787359957.069186:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508927744 00000100:00100000:0.0:1787359957.069233:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 275 00000100:00100000:0.0:1787359957.069242:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508927744:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359957.069293:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508927744:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 52us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359957.069300:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 275 00000040:00080000:3.0:1787359957.353584:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787359957.415206:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527837312:0@lo:400:kworker.0 00000100:00100000:1.0:1787359957.415286:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.415357:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787359957.415363:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527837184:0@lo:400:kworker.0 00000100:00100000:1.0:1787359957.415391:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359957.415447:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837312 00000100:00100000:1.0:1787359957.415457:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837312 00000100:00100000:1.0:1787359957.415520:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787359957.415529:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527837312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359957.415586:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527837312:12345-0@lo:400:kworker.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.415594:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787359957.415628:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787359957.415660:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d086d3800 x1874182527837312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359957.415674:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527837312:0@lo:400:kworker.0 00000100:00100000:1.0:1787359957.415721:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837184 00000100:00100000:1.0:1787359957.415724:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837184 00000100:00100000:1.0:1787359957.415756:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787359957.415763:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527837184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359957.415799:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527837184:12345-0@lo:400:kworker.0 Request processed in 37us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359957.415805:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1787359957.415818:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359957.415834:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527837184:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.416447:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527836928:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.416486:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359957.416528:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527837440:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.416551:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359957.416577:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787359957.416584:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527837056:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.416607:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359957.416633:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527837568:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.416655:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359957.416723:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837568 00000100:00100000:2.0:1787359957.416729:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837568 00000100:00100000:2.0:1787359957.416768:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787359957.416775:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1874182527837568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.416817:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1874182527837568:12345-0@lo:400:kworker.0 Request processed in 43us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.416822:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787359957.416855:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837440 00000100:00100000:2.0:1787359957.416859:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837440 00000100:00100000:2.0:1787359957.417058:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837056 00000100:00100000:2.0:1787359957.417062:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837056 00000100:00100000:2.0:1787359957.417077:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787359957.417082:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527837440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.417116:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527837440:12345-0@lo:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.417121:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787359957.417133:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787359957.417139:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527837056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.417167:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527837056:12345-0@lo:400:kworker.0 Request processed in 29us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.417173:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787359957.417303:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787359957.417307:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359957.417425:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527837056:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.417436:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527837568:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.417444:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527837440:0@lo:400:kworker.0 00000100:00100000:3.0:1787359957.417517:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527836928 00000100:00100000:3.0:1787359957.417521:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527836928 00000100:00100000:3.0:1787359957.417556:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787359957.417563:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527836928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359957.417607:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527836928:12345-0@lo:400:kworker.0 Request processed in 46us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359957.417623:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787359957.417813:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527836928:0@lo:400:kworker.0 00000100:00100000:2.0:1787359957.928445:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527837696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787359957.928520:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359957.928604:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837696 00000100:00100000:2.0:1787359957.928614:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837696 00000100:00100000:2.0:1787359957.928665:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359957.928703:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527837696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359957.928744:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359957.928807:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527837696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359957.928815:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787359957.928870:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527837696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359958.054836:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359959.079036:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359959.976371:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359959.976402:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527837824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359959.976564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359959.976648:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837824 00000100:00100000:2.0:1787359959.976656:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837824 00000100:00100000:2.0:1787359959.976754:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787359959.976764:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527837824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359959.976805:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787359959.976855:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527837824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359959.976862:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787359959.976886:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787359959.976922:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f4a80 x1874182527837824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359959.976942:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527837824:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787359960.056940:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1787359960.103418:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359961.127069:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359962.150964:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359962.191049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359962.191362:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928256 00000100:00100000:1.0:1787359962.191375:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928256 00000100:00100000:1.0:1787359962.191444:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 277 00000100:00100000:1.0:1787359962.191456:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508928256:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359962.191802:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182508928256:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 346us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.191821:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 277 00000100:00100000:2.0:1787359962.198099:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359962.203663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359962.203755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359962.203880:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928384 00000100:00100000:1.0:1787359962.203891:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928384 00000100:00100000:1.0:1787359962.203977:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928640 00000100:00100000:1.0:1787359962.203980:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928640 00000100:00100000:1.0:1787359962.204006:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 109 00000100:00100000:1.0:1787359962.204016:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2362:x1874182508928384:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359962.204122:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2362:x1874182508928384:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 107us (6039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.204131:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 109 00000100:00100000:1.0:1787359962.204150:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 110 00000100:00100000:1.0:1787359962.204156:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508928640:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359962.204182:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508928640:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.204188:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 110 00000100:00100000:1.0:1787359962.204208:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928512 00000100:00100000:1.0:1787359962.204212:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928512 00000100:00100000:1.0:1787359962.204249:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:1.0:1787359962.204256:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508928512:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359962.204285:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508928512:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.204291:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00080000:2.0:1787359962.205672:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359962.205703:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359962.535192:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527838208:0@lo:400:kworker.0 00000100:00100000:2.0:1787359962.535303:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359962.535421:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527837952:0@lo:400:kworker.0 00000100:00100000:0.0:1787359962.535502:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359962.535574:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527838080:0@lo:400:kworker.0 00000100:00100000:0.0:1787359962.535579:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527837952 00000100:00100000:0.0:1787359962.535589:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527837952 00000100:00100000:1.0:1787359962.535622:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359962.535664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787359962.535715:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527837952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.535722:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838208 00000100:00100000:1.0:1787359962.535742:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838208 00000100:00100000:1.0:1787359962.535809:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838080 00000100:00100000:1.0:1787359962.535813:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838080 00000100:00100000:1.0:1787359962.535834:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787359962.535842:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527838208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.535898:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527838208:12345-0@lo:400:kworker.0 Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.535907:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787359962.535942:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787359962.535949:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527838080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.535995:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527838080:12345-0@lo:400:kworker.0 Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359962.536003:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787359962.536030:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527837952:12345-0@lo:400:kworker.0 Request processed in 353us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359962.536056:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787359962.536089:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527838336:0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.536133:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359962.536247:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838336 00000100:00100000:0.0:1787359962.536254:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838336 00000100:00100000:0.0:1787359962.536309:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787359962.536319:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527838336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359962.536373:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527838336:12345-0@lo:400:kworker.0 Request processed in 56us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359962.536394:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1787359962.536438:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787359962.536444:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359962.536453:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.538880:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527837952:0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.538902:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787359962.538996:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359962.539467:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527838080:0@lo:400:kworker.0 00000100:00100000:2.0:1787359962.539479:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527838592:0@lo:400:kworker.0 00000100:00100000:2.0:1787359962.539518:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787359962.539713:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f8e1f80 x1874182527838336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359962.539737:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527838336:0@lo:400:kworker.0 00000100:00100000:0.0:1787359962.540059:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838464 00000100:00100000:0.0:1787359962.540067:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838464 00000100:00100000:0.0:1787359962.540138:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787359962.540148:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527838464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359962.540228:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527838464:12345-0@lo:400:kworker.0 Request processed in 82us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359962.540236:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787359962.540273:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527838464:0@lo:400:kworker.0 00000100:00080000:2.0:1787359962.540611:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359962.540995:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838592 00000100:00100000:3.0:1787359962.541010:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838592 00000100:00100000:3.0:1787359962.541090:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787359962.541099:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527838592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359962.541203:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527838592:12345-0@lo:400:kworker.0 Request processed in 104us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359962.541211:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787359962.541347:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787359962.541356:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f8e3b80, transno 4294967300 00000100:00100000:1.0:1787359962.541379:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527838592:0@lo:400:kworker.0 00000100:00080000:2.0:1787359962.541638:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787359963.048304:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527838720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359963.048397:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359963.049294:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838720 00000100:00100000:1.0:1787359963.049304:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838720 00000100:00100000:1.0:1787359963.049372:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787359963.049381:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527838720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787359963.049416:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787359963.051399:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527838720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2010us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359963.051416:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787359963.051601:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527838720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787359963.175096:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359964.198853:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359965.095036:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527838848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359965.095108:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359965.095174:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838848 00000100:00100000:1.0:1787359965.095184:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838848 00000100:00100000:1.0:1787359965.095244:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787359965.095255:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527838848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787359965.095290:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787359965.095341:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527838848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359965.095348:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787359965.095461:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1e3f5180 x1874182527838848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787359965.095480:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527838848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787359965.096111:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787359965.226285:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359966.247336:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359967.270987:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359967.309385:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359967.309446:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359967.309484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359967.309531:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359967.309597:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928896 00000100:00100000:0.0:1787359967.309616:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928896 00000100:00100000:0.0:1787359967.309747:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929152 00000100:00100000:0.0:1787359967.309751:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929152 00000100:00100000:0.0:1787359967.309783:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 114 00000100:00100000:0.0:1787359967.309811:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508928896:12345-192.168.201.14@tcp:400:kworker.0 00000100:00080000:3.0:1787359967.309856:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359967.309923:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508928896:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 114us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359967.309930:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:0.0:1787359967.309948:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 114 00000100:00100000:2.0:1787359967.310123:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508928768 00000100:00100000:2.0:1787359967.310129:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508928768 00000100:00100000:2.0:1787359967.310172:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 279 00000100:00100000:2.0:1787359967.310180:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508928768:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359967.310210:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508928768:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359967.310218:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 279 00000100:00100000:3.0:1787359967.310372:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508929152:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359967.310538:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508929152:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 591us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359967.310547:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:1.0:1787359967.310609:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929024 00000100:00100000:1.0:1787359967.310616:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929024 00000100:00100000:1.0:1787359967.310665:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:1.0:1787359967.310700:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508929024:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359967.310743:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508929024:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 70us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359967.310751:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00080000:3.0:1787359967.310761:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787359967.593123:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787359967.655052:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527839360:0@lo:400:kworker.0 00000100:00100000:3.0:1787359967.655069:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527839232:0@lo:400:kworker.0 00000100:00100000:2.0:1787359967.655216:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527839104:0@lo:400:kworker.0 00000100:00100000:1.0:1787359967.655460:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527838976:0@lo:400:kworker.0 00000100:00100000:0.0:1787359967.657231:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359967.657380:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839360 00000100:00100000:0.0:1787359967.657390:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839360 00000100:00100000:3.0:1787359967.657536:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787359967.657792:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359967.657799:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787359967.657818:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527839360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359967.657820:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839232 00000100:00100000:3.0:1787359967.657842:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839232 00000100:00100000:3.0:1787359967.657913:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787359967.657928:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527839232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359967.657934:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527839360:12345-0@lo:400:kworker.0 Request processed in 120us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359967.657945:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1787359967.658004:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3a20fb80 x1874182527839360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787359967.658022:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527839360:0@lo:400:kworker.0 00000100:00100000:3.0:1787359967.658067:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527839232:12345-0@lo:400:kworker.0 Request processed in 141us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359967.658078:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787359967.658106:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359967.658137:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527839232:0@lo:400:kworker.0 00000100:00100000:2.0:1787359967.659518:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359967.659572:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527839616:0@lo:400:kworker.0 00000100:00100000:3.0:1787359967.659607:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839104 00000100:00100000:3.0:1787359967.659617:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839104 00000100:00100000:2.0:1787359967.659624:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359967.659709:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787359967.659719:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527839104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359967.659803:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527839104:12345-0@lo:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359967.659810:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787359967.660003:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527839104:0@lo:400:kworker.0 00000100:00100000:0.0:1787359967.661259:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839616 00000100:00100000:0.0:1787359967.661283:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839616 00000100:00100000:0.0:1787359967.661379:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787359967.661391:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527839616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359967.661492:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527839616:12345-0@lo:400:kworker.0 Request processed in 103us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359967.661500:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787359967.661548:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527839616:0@lo:400:kworker.0 00000100:00080000:3.0:1787359967.661621:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787359967.664006:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359967.664093:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527839488:0@lo:400:kworker.0 00000100:00100000:1.0:1787359967.664139:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359967.664268:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839488 00000100:00100000:2.0:1787359967.664289:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839488 00000100:00100000:2.0:1787359967.664370:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787359967.664396:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527839488:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787359967.664621:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359967.664885:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527839488:12345-0@lo:400:kworker.0 Request processed in 491us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359967.664894:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787359967.664981:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527839488:0@lo:400:kworker.0 00000100:00100000:0.0:1787359967.665358:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527838976 00000100:00100000:0.0:1787359967.665374:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527838976 00000100:00100000:0.0:1787359967.665415:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787359967.665426:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527838976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359967.665634:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527838976:12345-0@lo:400:kworker.0 Request processed in 210us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359967.665641:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787359967.672520:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527838976:0@lo:400:kworker.0 00000100:00100000:1.0:1787359968.169219:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787359968.169246:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527839744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359968.169346:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359968.169553:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839744 00000100:00100000:3.0:1787359968.169564:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839744 00000100:00100000:3.0:1787359968.169626:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787359968.169638:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527839744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787359968.169714:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359968.169779:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527839744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359968.169788:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787359968.169886:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527839744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359968.295061:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359969.320620:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359970.215750:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527839872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359970.215835:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359970.215932:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527839872 00000100:00100000:2.0:1787359970.215943:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527839872 00000100:00100000:2.0:1787359970.216007:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787359970.216017:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527839872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359970.216057:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787359970.216119:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527839872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359970.216127:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787359970.216176:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d1dc8dc00 x1874182527839872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359970.216194:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527839872:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787359970.216243:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359970.343137:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359971.368045:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359972.392473:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359972.435143:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359972.435213:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359972.435315:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929408 00000100:00100000:0.0:1787359972.435327:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929408 00000100:00100000:0.0:1787359972.435413:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 119 00000100:00100000:0.0:1787359972.435424:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508929408:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359972.435507:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508929408:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 84us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.435514:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 119 00000100:00100000:1.0:1787359972.435651:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929280 00000100:00100000:1.0:1787359972.435656:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929280 00000100:00100000:1.0:1787359972.435721:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 281 00000100:00100000:1.0:1787359972.435729:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508929280:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359972.435770:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20038850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508929280:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 43us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359972.435776:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 281 00000100:00080000:2.0:1787359972.438708:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359972.448568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359972.448646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359972.448783:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929664 00000100:00100000:3.0:1787359972.448798:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929664 00000100:00100000:3.0:1787359972.448884:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 120 00000100:00100000:3.0:1787359972.448896:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508929664:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359972.448999:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182508929664:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359972.449008:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 120 00000100:00100000:0.0:1787359972.449287:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929536 00000100:00100000:0.0:1787359972.449291:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929536 00000100:00100000:0.0:1787359972.449333:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:0.0:1787359972.449341:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2361:x1874182508929536:12345-192.168.201.14@tcp:9:kworker.0 00000020:00000080:0.0:1787359972.449366:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef38b9 00000100:00080000:0.0:1787359972.449376:0:6701:0:(import.c:65:import_set_state_nolock()) ffff983d407ff800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787359972.449417:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787359972.449653:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+2:2361:x1874182508929536:12345-192.168.201.14@tcp:9:kworker.0 Request processed in 312us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.449661:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 19 00010000:00010000:0.0:1787359972.449716:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787359972.452319:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359972.452330:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359972.775268:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527840000:0@lo:400:kworker.0 00000100:00100000:0.0:1787359972.775291:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527840128:0@lo:400:kworker.0 00000100:00100000:2.0:1787359972.775368:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527840256:0@lo:400:kworker.0 00000100:00100000:1.0:1787359972.775768:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527840384:0@lo:400:kworker.0 00000100:00100000:3.0:1787359972.777308:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359972.777554:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359972.777592:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527840640:0@lo:400:kworker.0 00000100:00100000:3.0:1787359972.777594:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527840512:0@lo:400:kworker.0 00000100:00100000:0.0:1787359972.777643:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359972.777649:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359972.777731:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840000 00000100:00100000:0.0:1787359972.777844:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840000 00000100:00100000:0.0:1787359972.777900:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787359972.777911:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527840000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359972.781532:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840128 00000100:00100000:3.0:1787359972.781547:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840128 00000100:00100000:3.0:1787359972.781594:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840512 00000100:00100000:3.0:1787359972.781596:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840512 00000100:00100000:1.0:1787359972.781602:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359972.781643:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787359972.781655:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527840128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359972.781818:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840640 00000100:00100000:1.0:1787359972.781823:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840640 00000100:00100000:1.0:1787359972.781853:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840384 00000100:00100000:1.0:1787359972.781856:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840384 00000100:00100000:1.0:1787359972.781873:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787359972.781879:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527840640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359972.781920:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527840640:12345-0@lo:400:kworker.0 Request processed in 41us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359972.781928:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787359972.781946:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787359972.781967:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527840384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359972.782014:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527840384:12345-0@lo:400:kworker.0 Request processed in 48us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359972.782019:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787359972.782038:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787359972.782045:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527840512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359972.782083:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527840512:12345-0@lo:400:kworker.0 Request processed in 39us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359972.782089:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1787359972.782129:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d086d3480 x1874182527840384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359972.782143:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527840384:0@lo:400:kworker.0 00000100:00100000:1.0:1787359972.782326:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527840640:0@lo:400:kworker.0 00000100:00080000:1.0:1787359972.782382:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359972.782387:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787359972.782389:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359972.782413:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527840512:0@lo:400:kworker.0 00000100:00100000:3.0:1787359972.783427:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527840128:12345-0@lo:400:kworker.0 Request processed in 1772us (5871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359972.783444:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787359972.785644:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527840128:0@lo:400:kworker.0 00000100:00100000:0.0:1787359972.788579:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d20039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527840000:12345-0@lo:400:kworker.0 Request processed in 10659us (11265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.788597:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787359972.788919:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359972.789098:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840256 00000100:00100000:0.0:1787359972.789110:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840256 00000100:00100000:1.0:1787359972.789613:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527840000:0@lo:400:kworker.0 00000100:00100000:0.0:1787359972.789706:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787359972.789717:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527840256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359972.789819:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527840256:12345-0@lo:400:kworker.0 Request processed in 104us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359972.789826:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787359972.789887:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527840256:0@lo:400:kworker.0 00000100:00080000:3.0:1787359972.790117:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359973.288543:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787359973.288565:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527840768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359973.288635:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359973.288795:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840768 00000100:00100000:2.0:1787359973.288804:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840768 00000100:00100000:2.0:1787359973.288866:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787359973.288876:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527840768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359973.288914:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359973.288967:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527840768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359973.288974:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787359973.289040:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527840768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787359973.414941:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359974.439118:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787359975.339920:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527840896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359975.340003:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359975.340079:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527840896 00000100:00100000:1.0:1787359975.340095:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527840896 00000100:00100000:1.0:1787359975.340152:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787359975.340162:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527840896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787359975.340199:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1787359975.340250:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527840896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359975.340258:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787359975.340302:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f8cfb80 x1874182527840896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359975.340321:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527840896:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787359975.341293:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359975.462923:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787359975.463196:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:2.0:1787359975.463202:0:7649:0:(genops.c:885:class_export_put()) final put ffff983d407f9000/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:2.0:1787359975.463225:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d407f9000/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 for lustre-OST0001 00000020:00000080:2.0:1787359975.463270:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d407ff800 for lustre-OST0001 00010000:00010000:3.0:1787359976.490807:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787359977.510840:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359977.548827:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359977.548880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359977.548912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359977.549014:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929792 00000100:00100000:0.0:1787359977.549028:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929792 00000100:00100000:0.0:1787359977.549094:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 283 00000100:00100000:0.0:1787359977.549106:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508929792:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359977.549181:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508929792:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 77us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359977.549188:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 283 00000100:00100000:3.0:1787359977.549287:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508930048 00000100:00100000:3.0:1787359977.549292:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508930048 00000100:00100000:3.0:1787359977.549342:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508929920 00000100:00100000:3.0:1787359977.549345:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508929920 00000100:00100000:3.0:1787359977.549368:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 124 00000100:00100000:3.0:1787359977.549376:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508930048:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359977.549409:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508930048:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 34us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359977.549416:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 124 00000100:00100000:3.0:1787359977.549430:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 125 00000100:00100000:3.0:1787359977.549436:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508929920:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359977.549474:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182508929920:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 38us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359977.549481:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 125 00000100:00080000:0.0:1787359977.550000:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787359977.835184:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787359977.894895:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527841280:0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.894969:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359977.895075:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841280 00000100:00100000:1.0:1787359977.895086:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841280 00000100:00100000:1.0:1787359977.895146:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787359977.895156:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527841280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895211:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527841280:12345-0@lo:400:kworker.0 Request processed in 56us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359977.895218:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787359977.895280:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527841280:0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895323:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527841408:0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895350:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359977.895375:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527841024:0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895377:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841408 00000100:00100000:1.0:1787359977.895381:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841408 00000100:00100000:1.0:1787359977.895418:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359977.895420:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359977.895425:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527841408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359977.895446:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359977.895452:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527841152:0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895457:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527841408:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359977.895463:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787359977.895474:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787359977.895493:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d086d1c00 x1874182527841408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787359993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787359977.895503:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527841408:0@lo:400:kworker.0 00000100:00100000:2.0:1787359977.895548:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527841536:0@lo:400:kworker.0 00000100:00100000:2.0:1787359977.895572:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359977.895606:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787359977.895612:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527841664:0@lo:400:kworker.0 00000100:00080000:0.0:1787359977.895633:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359977.895634:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787359977.895643:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359977.895665:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841024 00000100:00100000:2.0:1787359977.895669:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841664 00000100:00100000:0.0:1787359977.895669:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841024 00000100:00100000:2.0:1787359977.895671:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841664 00000100:00100000:2.0:1787359977.895732:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787359977.895739:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527841664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895741:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841152 00000100:00100000:1.0:1787359977.895744:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841152 00000100:00100000:1.0:1787359977.895763:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841536 00000100:00100000:1.0:1787359977.895766:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841536 00000100:00100000:2.0:1787359977.895773:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527841664:12345-0@lo:400:kworker.0 Request processed in 35us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359977.895779:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787359977.895785:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787359977.895790:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527841152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359977.895804:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527841664:0@lo:400:kworker.0 00000100:00100000:2.0:1787359977.895820:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527841152:0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895820:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527841152:12345-0@lo:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359977.895826:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787359977.895838:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787359977.895844:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527841536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359977.895882:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527841536:12345-0@lo:400:kworker.0 Request processed in 38us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359977.895887:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787359977.896057:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527841536:0@lo:400:kworker.0 00000100:00100000:0.0:1787359977.898858:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787359977.898880:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527841024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359977.898978:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2003bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527841024:12345-0@lo:400:kworker.0 Request processed in 107us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359977.898986:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1787359977.899038:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787359977.899044:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359977.899456:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527841024:0@lo:400:kworker.0 00000001:02000400:0.0:1787359978.282274:0:11857:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:52:56 (1787359976) 00000100:00100000:1.0:1787359978.409054:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527841792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787359978.409359:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359978.410341:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841792 00000100:00100000:2.0:1787359978.410355:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841792 00000100:00100000:2.0:1787359978.410419:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359978.410430:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527841792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787359978.410471:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787359978.410546:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527841792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359978.410553:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787359978.410611:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527841792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359978.534819:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359979.564723:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359979.641926:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359979.642064:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508930176 00000100:00100000:1.0:1787359979.642092:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508930176 00000100:00100000:1.0:1787359979.642196:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:1.0:1787359979.642209:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:10228:x1874182508930176:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787359979.642234:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359979.642261:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4c9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.642338:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef398b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.642353:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef398b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.642369:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef398b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787359979.642459:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787359979.642601:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787359979.642606:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359979.642750:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef398b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.642779:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4c9 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.642801:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef398b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4c9 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.642810:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336300) 00010000:00010000:1.0:1787359979.642813:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787359979.642817:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2c00, rc 0) 00000100:00100000:1.0:1787359979.642898:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:10228:x1874182508930176:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 691us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359979.642906:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:3.0:1787359979.653849:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359979.654440:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508930304 00000100:00100000:1.0:1787359979.654453:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508930304 00000100:00100000:1.0:1787359979.654530:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:1.0:1787359979.654542:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:10229:x1874182508930304:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787359979.654577:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359979.654602:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4d0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.654726:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.654743:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.654755:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.654771:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.654779:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.654786:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.655492:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2a00/0x72f6de40e4ef39a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.655511:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2a00/0x72f6de40e4ef39a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.655519:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2a00/0x72f6de40e4ef39a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359979.656009:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787359979.656015:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359979.656099:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2a00/0x72f6de40e4ef39a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656113:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656119:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656124:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656143:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359979.656147:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656154:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656167:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336300) 00010000:00010000:1.0:1787359979.656170:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359979.656174:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656190:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656202:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656208:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656213:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656217:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359979.656219:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656225:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656233:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff983d20336400) 00010000:00010000:1.0:1787359979.656235:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359979.656237:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656242:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef39a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656275:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4d0 expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656290:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2a00/0x72f6de40e4ef39a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4d0 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359979.656303:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff983d20336e00) 00010000:00010000:1.0:1787359979.656305:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787359979.656308:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2a00, rc 0) 00000100:00100000:1.0:1787359979.656388:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:10229:x1874182508930304:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1846us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359979.656396:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:3.0:1787359979.661289:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359979.662257:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508930560 00000100:00100000:1.0:1787359979.662271:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508930560 00000100:00100000:0.0:1787359979.662416:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:0.0:1787359979.662431:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:10229:x1874182508930560:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787359979.662453:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359979.662478:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef39ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4d7 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.662574:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.662590:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.662603:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.662664:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.662708:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.662715:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663331:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef39c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663342:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef39c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663350:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef39c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359979.663359:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787359979.663567:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663576:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663582:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663588:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359979.663593:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663601:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663637:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff983d20336e00) 00010000:00010000:0.0:1787359979.663641:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359979.663645:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663651:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef39b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663664:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663671:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663714:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663719:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359979.663722:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663729:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663737:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff983d09750800) 00010000:00010000:0.0:1787359979.663740:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359979.663743:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.663749:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef39bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.669225:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef39ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4d7 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.669253:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef39c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4d7 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359979.669263:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:0.0:1787359979.669266:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359979.669271:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40e00, rc 0) 00000100:00100000:0.0:1787359979.669360:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10229:x1874182508930560:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 6932us (8079us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787359979.669369:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:2.0:1787359979.684096:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359979.684209:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508930688 00000100:00100000:0.0:1787359979.684221:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508930688 00000100:00100000:0.0:1787359979.684291:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:0.0:1787359979.684303:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10229:x1874182508930688:12345-192.168.201.14@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787359979.684455:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10229:x1874182508930688:12345-192.168.201.14@tcp:59:lhsmtool_posix.0 Request processed in 153us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359979.684463:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 35 00000040:00080000:1.0:1787359979.898767:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787359980.457250:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527841920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787359980.457330:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359980.457895:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527841920 00000100:00100000:2.0:1787359980.457906:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527841920 00000100:00100000:2.0:1787359980.457967:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787359980.457977:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527841920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787359980.458014:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787359980.458081:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527841920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359980.458089:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787359980.458131:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d086d3480 x1874182527841920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787359996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787359980.458149:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527841920:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787359980.460206:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787359980.498552:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1787359980.588723:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359981.469624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359981.474584:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508930816 00000100:00100000:3.0:1787359981.474613:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508930816 00000100:00100000:3.0:1787359981.474716:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:3.0:1787359981.474729:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:10272:x1874182508930816:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359981.474752:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359981.474779:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef39d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4de expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.474852:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.474870:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.474884:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.474904:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.474912:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.474919:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.475196:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.475205:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.475223:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.475229:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359981.475233:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.475240:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476294:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336300) 00010000:00010000:3.0:1787359981.476302:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359981.476310:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476318:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef39d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476337:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476343:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476349:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476355:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359981.476358:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476380:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476392:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff983d0947c300) 00010000:00010000:3.0:1787359981.476395:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359981.476398:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476404:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef39df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476605:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef39d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4de expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476619:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336300) 00010000:00010000:3.0:1787359981.476621:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359981.476626:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef39d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4de expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.476637:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62200, rc 0) 00000100:00100000:3.0:1787359981.476732:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:10272:x1874182508930816:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 2004us (7144us total) trans 0 rc 301/301 00000100:00100000:3.0:1787359981.476742:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00080000:3.0:1787359981.480831:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359981.487663:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.487763:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931072 00000100:00100000:0.0:1787359981.487776:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931072 00000100:00100000:0.0:1787359981.487841:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:0.0:1787359981.487854:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:10272:x1874182508931072:12345-192.168.201.14@tcp:36:lfs.0 00010000:00010000:0.0:1787359981.487914:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359981.487951:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef398b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4c9 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.487971:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d20336300) 00010000:00010000:0.0:1787359981.487984:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359981.488266:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.488281:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.488291:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.488306:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.488313:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.488319:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359981.491061:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787359981.491080:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.491147:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.491156:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.491177:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359981.491183:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.491191:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.491210:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:0.0:1787359981.491213:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359981.491218:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.491223:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39e6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787359981.491246:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b401e8c reply state 0000000043c9b03e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359981.491486:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787359981.491656:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10272:x1874182508931072:12345-192.168.201.14@tcp:36:lfs.0 Request processed in 3799us (3999us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787359981.491665:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 37 00010000:00010000:3.0:1787359981.509653:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.509670:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.509807:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.509814:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359981.509819:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.509828:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.509861:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff983d09750800) 00010000:00010000:3.0:1787359981.509865:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359981.509871:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.509878:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef39ed lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359981.559443:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.559899:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931200 00000100:00100000:0.0:1787359981.559912:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931200 00000100:00100000:0.0:1787359981.559980:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 38 00000100:00100000:0.0:1787359981.559992:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:10280:x1874182508931200:12345-192.168.201.14@tcp:101:lctl.0 00010000:00010000:0.0:1787359981.560018:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359981.560044:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4e5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.560123:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef39fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.560138:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef39fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.560150:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef39fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359981.560209:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787359981.560212:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787359981.560250:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef39fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.560275:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef39f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4e5 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.560292:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef39fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4e5 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.560302:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:0.0:1787359981.560305:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787359981.560309:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41a00, rc 0) 00000100:00100000:0.0:1787359981.560390:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10280:x1874182508931200:12345-192.168.201.14@tcp:101:lctl.0 Request processed in 388us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359981.560398:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 38 00010000:00010000:0.0:1787359981.613977:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359981.640977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359981.641597:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931328 00000100:00100000:3.0:1787359981.641611:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931328 00000100:00100000:3.0:1787359981.641718:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:3.0:1787359981.641732:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10286:x1874182508931328:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:3.0:1787359981.641754:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359981.641779:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3a02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4ec expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642128:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642157:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642171:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642189:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642197:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642204:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642321:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef3a17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642329:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef3a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642336:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef3a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359981.642372:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787359981.642375:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359981.642418:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef3a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642431:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642762:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642771:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642778:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359981.642782:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642790:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642804:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:3.0:1787359981.642807:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359981.642812:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642818:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642957:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642965:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642971:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642976:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359981.642986:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.642993:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.643001:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff983d0947c100) 00010000:00010000:3.0:1787359981.643004:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359981.643007:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.643012:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.643045:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3a02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4ec expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.643058:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef3a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4ec expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.643064:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359981.643066:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787359981.643068:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63200, rc 0) 00000100:00100000:3.0:1787359981.643184:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:10286:x1874182508931328:12345-192.168.201.14@tcp:101:bash.0 Request processed in 1455us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359981.643193:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:3.0:1787359981.651078:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.652354:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931584 00000100:00100000:0.0:1787359981.652384:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931584 00000100:00100000:0.0:1787359981.652466:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:0.0:1787359981.652478:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:10286:x1874182508931584:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787359981.652502:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359981.652527:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4f3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.652704:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.652720:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.652732:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.652788:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.652796:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.652804:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787359981.653533:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787359981.653760:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.653772:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.653792:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.653828:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.653833:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.653838:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.653842:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359981.653846:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.655815:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.655837:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359981.655840:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359981.655846:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.655858:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787359981.655877:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000357676a5 reply state 0000000011c9adb0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359981.655887:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787359981.655955:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.655968:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.655973:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787359981.655975:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787359981.655976:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:0.0:1787359981.656042:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10286:x1874182508931584:12345-192.168.201.14@tcp:101:bash.0 Request processed in 3567us (4976us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787359981.656049:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:3.0:1787359981.660274:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359981.660376:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931712 00000100:00100000:2.0:1787359981.660390:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931712 00000100:00100000:2.0:1787359981.660446:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:2.0:1787359981.660455:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874182508931712:12345-192.168.201.14@tcp:8:bash.0 00010000:00080000:2.0:1787359981.660492:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:2.0:1787359981.660528:0:6701:0:(genops.c:1385:class_connect()) connect: client 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430, cookie 0x72f6de40e4ef3a41 00002000:00100000:2.0:1787359981.660541:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430/ffff983d054d9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787359981.660552:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00010000:1.0:1787359981.660662:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.660707:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.660715:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.660721:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359981.660726:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.660734:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.660768:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750d00) 00010000:00010000:1.0:1787359981.660771:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359981.660776:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.660782:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3a2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787359981.660824:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787359981.660957:0:6701:0:(import.c:65:import_set_state_nolock()) ffff983d054df000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787359981.661078:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2361:x1874182508931712:12345-192.168.201.14@tcp:8:bash.0 Request processed in 621us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.661097:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:2.0:1787359981.664817:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359981.664905:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931840 00000100:00100000:1.0:1787359981.664918:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931840 00000100:00100000:1.0:1787359981.664991:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:1.0:1787359981.665002:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:0:x1874182508931840:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:1.0:1787359981.665022:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359981.665047:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce4fa expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787359981.665076:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787359981.665099:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1787359981.665104:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359981.665116:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.665139:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.665156:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3800, rc 0) 00000100:00100000:1.0:1787359981.665217:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:0:x1874182508931840:12345-192.168.201.14@tcp:101:bash.0 Request processed in 216us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359981.665238:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00080000:3.0:1787359981.665418:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359981.669529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359981.669628:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508931968 00000100:00100000:3.0:1787359981.669655:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508931968 00000100:00100000:3.0:1787359981.669979:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:3.0:1787359981.669993:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:10286:x1874182508931968:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:3.0:1787359981.670013:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359981.670038:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce501 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.670080:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.670090:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359981.670095:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359981.670100:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.670141:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.670156:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359981.670170:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1874182527842048:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787359981.670431:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359981.672970:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1874182527842048:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359981.673016:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.673063:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63c00, rc 0) 00000100:00100000:3.0:1787359981.673131:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:10286:x1874182508931968:12345-192.168.201.14@tcp:101:bash.0 Request processed in 3140us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359981.673141:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:2.0:1787359981.677391:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359981.677484:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508932096 00000100:00100000:3.0:1787359981.677497:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508932096 00010000:00010000:3.0:1787359981.677547:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359981.677607:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:3.0:1787359981.677618:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508932096:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359981.677635:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359981.677660:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.677714:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.677747:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061019f3e/0x72f6de40e4ef3a48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4fa expref: 8 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.677768:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787359981.677773:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359981.677784:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.677809:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.677862:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359981.677880:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527842176:192.168.201.14@tcp:105: 00000100:00100000:3.0:1787359981.677966:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787359981.680978:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527842176:192.168.201.14@tcp:105: 00010000:00010000:3.0:1787359981.681012:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359981.681074:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508932096:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 3457us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359981.681086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:1.0:1787359981.687604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359981.687823:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508932352 00000100:00100000:3.0:1787359981.687836:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508932352 00000100:00100000:2.0:1787359981.688184:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:2.0:1787359981.688197:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:10286:x1874182508932352:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:2.0:1787359981.688554:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10286:x1874182508932352:12345-192.168.201.14@tcp:35:bash.0 Request processed in 357us (973us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787359981.688563:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:2.0:1787359981.766511:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.766632:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508932608 00000100:00100000:0.0:1787359981.766646:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508932608 00000100:00100000:0.0:1787359981.766762:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:0.0:1787359981.766776:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10296:x1874182508932608:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359981.766805:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359981.766829:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce508 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359981.766962:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787359981.767088:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce508 expref: 15 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.767107:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:0.0:1787359981.767398:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787359981.767406:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce508 expref: 15 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.767439:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787359981.767497:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:10296:x1874182508932608:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 725us (995us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787359981.767506:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:3.0:1787359981.771041:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359981.771265:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508932864 00000100:00100000:1.0:1787359981.771279:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508932864 00000100:00100000:1.0:1787359981.771349:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:1.0:1787359981.771362:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:10296:x1874182508932864:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787359981.771659:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10296:x1874182508932864:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 299us (628us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787359981.771667:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:1.0:1787359981.820870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.821181:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508932992 00000100:00100000:0.0:1787359981.821194:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508932992 00000100:00100000:0.0:1787359981.821278:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:0.0:1787359981.821288:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10302:x1874182508932992:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359981.821313:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359981.821334:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce50f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.821400:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.821413:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.821423:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359981.821485:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787359981.821489:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787359981.821505:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.821525:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce50f expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.821554:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce50f expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.821560:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359981.821562:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787359981.821565:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787359981.821638:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:10302:x1874182508932992:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 350us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359981.821646:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:3.0:1787359981.824898:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359981.825304:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508933248 00000100:00100000:1.0:1787359981.825318:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508933248 00000100:00100000:1.0:1787359981.825457:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:1.0:1787359981.825467:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:10302:x1874182508933248:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359981.825486:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359981.825508:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3a72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce516 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.825622:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3a79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.825637:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.825649:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3a79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359981.825697:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787359981.825838:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3a72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce516 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.825862:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3a79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce516 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.825877:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787359981.825879:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787359981.825883:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2400, rc 0) 00000100:00100000:1.0:1787359981.825957:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10302:x1874182508933248:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 490us (1065us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787359981.825966:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:1.0:1787359981.828562:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359981.828714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359981.828772:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508933632 00000100:00100000:3.0:1787359981.828782:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508933632 00000100:00100000:3.0:1787359981.828843:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:3.0:1787359981.828853:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10302:x1874182508933632:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359981.828948:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359981.828971:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce51d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.829078:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.829091:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.829101:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359981.829120:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787359981.829221:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce51d expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.829235:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce51d expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359981.829241:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:3.0:1787359981.829244:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787359981.829246:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62200, rc 0) 00000100:00100000:3.0:1787359981.829310:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:10302:x1874182508933632:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 459us (596us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787359981.829315:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:0.0:1787359981.830433:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508933376 00000100:00100000:0.0:1787359981.830503:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508933376 00000100:00100000:0.0:1787359981.830668:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:0.0:1787359981.830708:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:2364:x1874182508933376:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359981.830724:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359981.830748:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef3a79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce516 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.830765:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787359981.830769:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359981.830813:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:2364:x1874182508933376:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 137us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359981.830833:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:3.0:1787359981.833085:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359981.833202:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508933760 00000100:00100000:2.0:1787359981.833212:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508933760 00000100:00100000:2.0:1787359981.833267:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:2.0:1787359981.833275:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508933760:12345-192.168.201.14@tcp:1:lfs.0 00010000:00010000:2.0:1787359981.833318:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.833337:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.833343:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787359981.833347:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787359981.833351:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.833383:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.833407:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 7 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359981.833420:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1874182527842304:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359981.833504:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d20054e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787359981.839534:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.839638:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508933888 00000100:00100000:0.0:1787359981.839652:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508933888 00002000:00100000:0.0:1787359981.839747:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff983d3f8e1880 x1874182508933888/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:172/0 lens 504/0 e 0 to 0 dl 1787359992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787359981.839776:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8e1880 with x1874182508933888 ext(0->12) 00010000:00010000:0.0:1787359981.839788:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 8 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.839805:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 8 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787359981.839814:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d3f8e1880 00000100:00100000:0.0:1787359981.839854:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:0.0:1787359981.839865:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508933888:12345-192.168.201.14@tcp:4:lfs.0 00000100:00100000:1.0:1787359981.840170:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1874182527842304:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359981.840199:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1787359981.891549:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000100:00100000:2.0:1787359981.892635:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508933888:12345-192.168.201.14@tcp:4:lfs.0 Request processed in 52761us (53102us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787359981.892655:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00002000:00100000:2.0:1787359981.892670:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff983d3f8e1880 x1874182508933888/t4294967299(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:172/0 lens 504/448 e 0 to 0 dl 1787359992 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787359981.892703:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8e1880 with x1874182508933888 ext(0->12) 00010000:00010000:2.0:1787359981.892716:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 9 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.892736:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 9 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787359981.892745:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d3f8e1880 00000100:00100000:2.0:1787359981.895086:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.895178:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508934016 00000100:00100000:0.0:1787359981.895189:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508934016 00010000:00010000:0.0:1787359981.895232:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 9 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359981.895313:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:0.0:1787359981.895324:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2365:x1874182508934016:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359981.895341:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787359981.895359:0:5848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787359981.895362:0:5848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787359981 00002000:00010000:0.0:1787359981.895364:0:5848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787359981 00002000:00010000:0.0:1787359981.895366:0:5848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787359981 00010000:00010000:0.0:1787359981.895372:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 9 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.895405:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 9 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.895432:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef3a4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce501 expref: 9 pid: 6698 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.895449:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787359981.895453:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787359981.895459:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.895468:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.895502:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359981.895552:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2365:x1874182508934016:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 229us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359981.895560:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 36 00010000:00010000:1.0:1787359981.895630:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895641:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895700:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895710:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895719:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895726:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359981.895731:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895740:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895753:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.895760:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef3a9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359981.895808:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508933760:12345-192.168.201.14@tcp:1:lfs.0 Request processed in 62532us (62729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359981.895815:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:2.0:1787359981.901946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359981.902140:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508934272 00000100:00100000:1.0:1787359981.902155:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508934272 00000100:00100000:1.0:1787359981.902229:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787359981.902242:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:10302:x1874182508934272:12345-192.168.201.14@tcp:35:lfs.0 00000004:00010000:1.0:1787359981.902325:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce51d expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787359981.902672:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787359981.903267:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787359981.904537:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787359981.904632:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.904655:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.904666:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.905232:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.905251:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 23 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359981.905269:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1874182527842432:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359981.905411:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fb000 going to sleep for 11 seconds 00000100:00100000:2.0:1787359981.908205:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359981.909082:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1874182527842432:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359981.909130:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359981.909210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508934400 00000100:00100000:0.0:1787359981.909219:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508934400 00010000:00010000:0.0:1787359981.909270:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 24 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359981.909356:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:0.0:1787359981.909366:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:2363:x1874182508934400:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359981.909394:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359981.909402:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 24 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.909416:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 24 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.909440:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4f3 expref: 24 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.909466:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787359981.909471:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.909481:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.909489:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.909519:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359981.909635:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:2363:x1874182508934400:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 269us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359981.909644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 37 00010000:00010000:1.0:1787359981.909699:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359981.909706:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787359981.909866:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787359981.910088:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787359981.910219:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527842560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787359981.910320:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359981.910354:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787359981.910721:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527842560 00000100:00100000:2.0:1787359981.910729:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527842560 00000100:00100000:2.0:1787359981.910784:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359981.910792:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1874182527842560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787359981.911014:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1874182527842560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 222us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359981.911023:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787359981.911066:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527842560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787359981.913423:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787359981.913617:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527842688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787359981.914036:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359981.914109:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d200549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359981.914164:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527842688 00000100:00100000:0.0:1787359981.914174:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527842688 00000100:00100000:0.0:1787359981.914265:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787359981.914277:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1874182527842688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787359981.914518:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5864:x1874182527842688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 242us (482us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787359981.914536:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787359981.914629:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527842688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787359981.914712:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787359981.914753:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.914765:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.914773:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.914780:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359981.914785:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.914793:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.914811:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787359981.914833:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787359981.914846:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359981.914854:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3aa3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787359981.915051:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787359981.915272:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787359981.915285:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356243607307ns, next at 357243604997ns, rc = 0 00000001:00080000:2.0:1787359981.915293:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787359981.915326:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787359981.915329:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787359981.915337:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3a8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce51d expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359981.915456:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:10302:x1874182508934272:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 13216us (13592us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787359981.915465:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000020:00080000:2.0:1787359981.915469:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787359981.918669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359981.918846:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508934528 00000100:00100000:0.0:1787359981.918859:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508934528 00000100:00100000:0.0:1787359981.919062:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:0.0:1787359981.919075:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:10302:x1874182508934528:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359981.919101:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359981.919128:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce524 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.919198:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce524 expref: 27 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.919214:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce524 expref: 27 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359981.919234:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359981.919237:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787359981.919241:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787359981.919353:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:10302:x1874182508934528:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 281us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359981.919361:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:3.0:1787359981.922812:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359981.930189:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508934784 00000100:00100000:2.0:1787359981.930208:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508934784 00000100:00100000:2.0:1787359981.930412:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:2.0:1787359981.930426:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1113a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:10302:x1874182508934784:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787359981.930745:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1113a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:10302:x1874182508934784:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 321us (7939us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787359981.930754:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:2.0:1787359982.023744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359982.024428:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508935040 00000100:00100000:1.0:1787359982.024440:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508935040 00000100:00100000:1.0:1787359982.024512:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:1.0:1787359982.024524:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:10312:x1874182508935040:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359982.024552:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359982.024588:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce52b expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359982.024731:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787359982.024831:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3ab1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce52b expref: 30 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.024847:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:1.0:1787359982.024851:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787359982.024871:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce52b expref: 30 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.024888:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2c00, rc 0) 00000100:00100000:1.0:1787359982.024961:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10312:x1874182508935040:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 438us (1226us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787359982.024969:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:3.0:1787359982.030309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.030486:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508935168 00000100:00100000:0.0:1787359982.030499:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508935168 00000100:00100000:0.0:1787359982.030591:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:0.0:1787359982.030604:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10312:x1874182508935168:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:0.0:1787359982.030730:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030763:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030777:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030797:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030805:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030812:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030930:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030939:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.030947:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787359982.030991:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031005:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031012:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031029:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031035:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359982.031040:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031049:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031064:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359982.031068:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359982.031073:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031080:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031095:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031101:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031107:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031112:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359982.031114:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031131:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031140:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750200) 00010000:00010000:0.0:1787359982.031142:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359982.031145:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031152:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031179:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031186:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031191:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031196:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359982.031199:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031205:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031212:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359982.031215:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359982.031218:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.031233:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359982.031312:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10312:x1874182508935168:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 708us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359982.031320:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:3.0:1787359982.039506:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359982.039639:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508935424 00000100:00100000:1.0:1787359982.039657:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508935424 00000100:00100000:1.0:1787359982.039778:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:1.0:1787359982.039791:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10312:x1874182508935424:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787359982.040338:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:10312:x1874182508935424:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 547us (845us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787359982.040348:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:2.0:1787359982.095025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359982.095171:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508935680 00000100:00100000:3.0:1787359982.095197:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508935680 00000100:00100000:3.0:1787359982.095312:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:3.0:1787359982.095323:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:10315:x1874182508935680:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359982.095348:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359982.095373:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce532 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095455:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095472:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095483:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095499:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095506:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095513:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095668:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095703:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095711:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359982.095729:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787359982.095843:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095861:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095868:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095874:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359982.095878:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095886:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095900:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359982.095903:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359982.095909:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095916:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095929:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095935:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095951:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095957:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359982.095960:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095966:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095976:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d0947c700) 00010000:00010000:3.0:1787359982.095978:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359982.095981:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.095987:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.096032:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.096047:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.096055:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:3.0:1787359982.096057:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787359982.096060:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63e00, rc 0) 00000100:00100000:3.0:1787359982.096130:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10315:x1874182508935680:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 808us (1115us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787359982.096147:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:2.0:1787359982.100276:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.100377:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508935808 00000100:00100000:0.0:1787359982.100389:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508935808 00000100:00100000:0.0:1787359982.100496:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:0.0:1787359982.100509:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10315:x1874182508935808:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:0.0:1787359982.100608:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100626:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100637:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100667:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100710:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100719:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100725:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359982.100730:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100754:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100769:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359982.100772:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787359982.100777:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.100783:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359982.101107:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10315:x1874182508935808:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 600us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359982.101117:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:3.0:1787359982.104201:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359982.104263:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508936064 00000100:00100000:3.0:1787359982.104275:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508936064 00000100:00100000:3.0:1787359982.104340:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:3.0:1787359982.104353:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10315:x1874182508936064:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:3.0:1787359982.104634:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:10315:x1874182508936064:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 282us (442us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787359982.104643:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:2.0:1787359982.405884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.406002:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508936320 00000100:00100000:0.0:1787359982.406015:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508936320 00000100:00100000:0.0:1787359982.406087:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:0.0:1787359982.406102:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:10346:x1874182508936320:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:0.0:1787359982.406130:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359982.406157:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce539 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.406266:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.406280:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.406292:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359982.406320:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787359982.406462:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce539 expref: 36 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.406484:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce539 expref: 35 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.406494:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359982.406497:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787359982.406501:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41000, rc 0) 00000100:00100000:0.0:1787359982.406586:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10346:x1874182508936320:12345-192.168.201.14@tcp:101:cat.0 Request processed in 469us (693us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787359982.406596:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:3.0:1787359982.411836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359982.411921:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508936576 00000100:00100000:2.0:1787359982.411940:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508936576 00000100:00100000:2.0:1787359982.412024:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:2.0:1787359982.412037:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10346:x1874182508936576:12345-192.168.201.14@tcp:35:cat.0 00000100:00100000:2.0:1787359982.412346:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:10346:x1874182508936576:12345-192.168.201.14@tcp:35:cat.0 Request processed in 311us (534us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787359982.412353:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:3.0:1787359982.413399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359982.413495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508936704 00000100:00100000:2.0:1787359982.413502:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508936704 00000100:00100000:2.0:1787359982.413553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:2.0:1787359982.413563:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:2365:x1874182508936704:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787359982.413761:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359982.413791:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce539 expref: 36 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.413810:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359982.413815:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359982.413904:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:2365:x1874182508936704:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 342us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359982.413913:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:0.0:1787359982.446162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359982.446294:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508936960 00000100:00100000:1.0:1787359982.446307:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508936960 00000100:00100000:1.0:1787359982.446412:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:1.0:1787359982.446426:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10352:x1874182508936960:12345-192.168.201.14@tcp:101:dd.0 00010000:00010000:1.0:1787359982.446456:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359982.446460:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787359982.446495:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce50f expref: 35 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.446521:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359982.446527:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359982.446545:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce540 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.446866:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.446882:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.446891:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.446932:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.446949:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 35 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359982.446964:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527842816:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359982.447163:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359982.449908:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527842816:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359982.449942:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359982.451217:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359982.452148:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508937088 00000100:00100000:3.0:1787359982.452160:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508937088 00010000:00010000:3.0:1787359982.452209:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 36 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359982.452258:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 38 00000100:00100000:3.0:1787359982.452270:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:2362:x1874182508937088:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359982.452288:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359982.452296:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 36 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.452311:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 36 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.452336:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3ae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce532 expref: 36 pid: 5862 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.452368:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:3.0:1787359982.452375:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.452385:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.452394:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.452585:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359982.452654:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:2362:x1874182508937088:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 385us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359982.452662:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 38 00010000:00010000:1.0:1787359982.453734:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.453747:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359982.453770:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787359982.454033:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.454053:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.454061:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359982.454064:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787359982.454067:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2e00, rc 0) 00000100:00100000:1.0:1787359982.454149:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10352:x1874182508936960:12345-192.168.201.14@tcp:101:dd.0 Request processed in 7725us (7997us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787359982.454158:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:0.0:1787359982.456493:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359982.456563:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508937344 00000100:00100000:3.0:1787359982.456595:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508937344 00000100:00100000:3.0:1787359982.456659:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00100000:3.0:1787359982.456671:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10352:x1874182508937344:12345-192.168.201.14@tcp:36:dd.0 00010000:00010000:3.0:1787359982.456998:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.457017:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.457029:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787359982.457082:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787359982.457109:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082c23e85 reply state 00000000ec9f5358 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359982.457129:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787359982.457220:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:10352:x1874182508937344:12345-192.168.201.14@tcp:36:dd.0 Request processed in 550us (735us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787359982.457227:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 52 00000020:00080000:3.0:1787359982.457233:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787359982.459071:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.459104:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.459112:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.459118:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359982.459123:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.459131:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.459151:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359982.459154:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359982.459161:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.459167:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3b28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359982.631146:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359982.639931:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359982.640156:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508937472 00000100:00100000:2.0:1787359982.640170:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508937472 00000100:00100000:2.0:1787359982.640290:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:2.0:1787359982.640303:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:10366:x1874182508937472:12345-192.168.201.14@tcp:101:stat.0 00010000:00010000:2.0:1787359982.640329:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359982.640352:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce547 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640420:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640447:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640459:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640475:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640482:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640489:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640596:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640608:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640616:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640658:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359982.640673:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 38 pid: 5863 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359982.640731:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527842944:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359982.640827:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1787359982.643030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.643197:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527842944:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359982.643231:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359982.643238:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508937728 00000100:00100000:1.0:1787359982.643246:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508937728 00000100:00100000:1.0:1787359982.643301:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:1.0:1787359982.643312:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:5601:x1874182508937728:12345-192.168.201.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787359982.643815:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:5601:x1874182508937728:12345-192.168.201.14@tcp:35:ldlm_bl.0 Request processed in 502us (792us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787359982.643824:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:3.0:1787359982.649523:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.649657:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508937856 00000100:00100000:0.0:1787359982.649670:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508937856 00010000:00010000:0.0:1787359982.649746:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 40 pid: 5863 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359982.649845:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:0.0:1787359982.649869:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:2362:x1874182508937856:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359982.649886:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359982.649894:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 40 pid: 5863 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.649911:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 40 pid: 5863 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.649936:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3b1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce540 expref: 40 pid: 5863 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.649956:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359982.649962:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.649973:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.649982:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.650023:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359982.650083:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:2362:x1874182508937856:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 215us (567us total) trans 0 rc 0/0 00010000:00010000:1.0:1787359982.650090:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359982.650091:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 39 00010000:00010000:1.0:1787359982.650107:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359982.650167:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787359982.650172:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359982.650223:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650245:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650258:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650263:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650268:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650272:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359982.650275:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650280:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650288:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359982.650290:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359982.650293:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650297:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650305:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650309:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650318:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650321:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359982.650323:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650326:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650331:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d25919000) 00010000:00010000:1.0:1787359982.650332:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359982.650334:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650337:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef3b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650366:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce547 expref: 39 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650376:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce547 expref: 38 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.650380:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359982.650382:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787359982.650383:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347a00, rc 0) 00000100:00100000:1.0:1787359982.650412:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:10366:x1874182508937472:12345-192.168.201.14@tcp:101:stat.0 Request processed in 10112us (10492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359982.650429:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:3.0:1787359982.668482:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359982.668547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.668980:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508938112 00000100:00100000:0.0:1787359982.668996:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508938112 00000100:00100000:0.0:1787359982.669082:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 129 00000100:00100000:0.0:1787359982.669095:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508938112:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359982.669191:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508938112:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 99us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359982.669200:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 129 00000100:00080000:3.0:1787359982.669357:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359982.669416:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508937984 00000100:00100000:2.0:1787359982.669422:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508937984 00000100:00100000:2.0:1787359982.669462:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 285 00000100:00100000:2.0:1787359982.669470:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508937984:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787359982.669509:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508937984:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 41us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359982.669517:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 285 00000100:00100000:3.0:1787359982.720115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359982.720236:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508938368 00000100:00100000:1.0:1787359982.720250:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508938368 00000100:00100000:1.0:1787359982.720330:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:1.0:1787359982.720342:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:10372:x1874182508938368:12345-192.168.201.14@tcp:36:truncate.0 00010000:00010000:1.0:1787359982.720414:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359982.720461:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce547 expref: 38 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.720485:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359982.720492:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359982.720799:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.720815:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.720838:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787359982.720900:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787359982.720926:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059cde29f reply state 000000009f48b39f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359982.720936:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787359982.721061:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:10372:x1874182508938368:12345-192.168.201.14@tcp:36:truncate.0 Request processed in 719us (954us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787359982.721070:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 54 00000020:00080000:1.0:1787359982.721089:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787359982.723227:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.723245:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.723254:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.723260:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359982.723265:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.723272:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.723289:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359982.723292:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359982.723297:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.723305:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359982.878318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359982.878505:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508938496 00000100:00100000:0.0:1787359982.878520:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508938496 00000100:00100000:0.0:1787359982.878741:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 55 00000100:00100000:0.0:1787359982.878753:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:10386:x1874182508938496:12345-192.168.201.14@tcp:101:stat.0 00010000:00010000:0.0:1787359982.878783:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359982.878808:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce54e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.878947:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.878964:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.878977:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.878994:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879002:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879009:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879113:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879136:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879144:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359982.879182:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787359982.879186:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787359982.879211:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879223:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879233:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879240:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879247:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879254:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359982.879259:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879267:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879281:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359982.879289:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359982.879294:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879301:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3b59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879315:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879321:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879326:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879331:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359982.879333:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879339:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879346:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750200) 00010000:00010000:0.0:1787359982.879349:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359982.879352:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879357:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879389:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879412:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 40 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359982.879420:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359982.879422:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787359982.879425:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:0.0:1787359982.879627:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:10386:x1874182508938496:12345-192.168.201.14@tcp:101:stat.0 Request processed in 875us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359982.879635:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 55 00000100:00100000:3.0:1787359982.960248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359982.960375:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508938752 00000100:00100000:1.0:1787359982.960388:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508938752 00000100:00100000:1.0:1787359982.960474:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:1.0:1787359982.960487:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:10396:x1874182508938752:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359982.960511:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359982.960536:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce555 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359982.960730:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787359982.960883:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce555 expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.960901:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:1.0:1787359982.960904:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787359982.960910:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce555 expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359982.960927:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2c00, rc 0) 00000100:00100000:1.0:1787359982.960996:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:10396:x1874182508938752:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 511us (760us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787359982.961004:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:3.0:1787359982.964782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359982.964969:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508939008 00000100:00100000:1.0:1787359982.964982:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508939008 00000100:00100000:1.0:1787359982.965052:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:1.0:1787359982.965064:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:10396:x1874182508939008:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787359982.965350:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+42:10396:x1874182508939008:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 288us (577us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787359982.965359:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:2.0:1787359983.016303:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527843456:0@lo:400:kworker.0 00000100:00100000:2.0:1787359983.016390:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359983.016471:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787359983.016478:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527843328:0@lo:400:kworker.0 00000100:00100000:2.0:1787359983.016508:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359983.016546:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527843456 00000100:00100000:2.0:1787359983.016556:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527843456 00000100:00100000:2.0:1787359983.016642:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787359983.016654:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527843456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359983.016742:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f196300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527843456:12345-0@lo:400:kworker.0 Request processed in 90us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.016750:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787359983.016772:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787359983.016804:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527843456:0@lo:400:kworker.0 00000100:00100000:2.0:1787359983.016849:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527843328 00000100:00100000:2.0:1787359983.016866:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527843328 00000100:00100000:2.0:1787359983.016902:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787359983.016909:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527843328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359983.016946:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527843328:12345-0@lo:400:kworker.0 Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.016953:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1787359983.016966:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359983.016981:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527843328:0@lo:400:kworker.0 00000100:00100000:1.0:1787359983.017187:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527843200:0@lo:400:kworker.0 00000100:00100000:1.0:1787359983.017222:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.017253:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527843712:0@lo:400:kworker.0 00000100:00100000:1.0:1787359983.017277:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.017312:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787359983.017319:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527843072:0@lo:400:kworker.0 00000100:00100000:1.0:1787359983.017345:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.017364:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527843584:0@lo:400:kworker.0 00000100:00100000:1.0:1787359983.017385:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359983.017408:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527843712 00000100:00100000:1.0:1787359983.017412:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527843712 00000100:00100000:1.0:1787359983.017443:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787359983.017450:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527843712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359983.017484:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527843712:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.017490:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787359983.017515:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527843712:0@lo:400:kworker.0 00000100:00100000:0.0:1787359983.018012:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527843072 00000100:00100000:0.0:1787359983.018019:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527843072 00000100:00100000:0.0:1787359983.018061:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787359983.018070:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527843072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359983.018119:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527843072:12345-0@lo:400:kworker.0 Request processed in 51us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.018126:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787359983.018155:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527843200 00000100:00100000:0.0:1787359983.018158:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527843200 00000100:00100000:0.0:1787359983.018177:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527843584 00000100:00100000:0.0:1787359983.018180:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527843584 00000100:00100000:0.0:1787359983.018197:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787359983.018203:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527843200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359983.018230:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527843200:12345-0@lo:400:kworker.0 Request processed in 28us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.018237:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787359983.018248:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787359983.018264:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527843584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359983.018295:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527843584:12345-0@lo:400:kworker.0 Request processed in 32us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.018300:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787359983.018384:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f196d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527843072:0@lo:400:kworker.0 00000100:00100000:3.0:1787359983.018397:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527843584:0@lo:400:kworker.0 00000100:00100000:3.0:1787359983.018405:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527843200:0@lo:400:kworker.0 00000100:00080000:2.0:1787359983.018597:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787359983.018601:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787359983.036922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359983.037094:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508939264 00000100:00100000:0.0:1787359983.037106:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508939264 00000100:00100000:0.0:1787359983.037202:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 57 00000100:00100000:0.0:1787359983.037214:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+42:10401:x1874182508939264:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787359983.037242:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359983.037266:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3b7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce55c expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.037372:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.037389:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.037397:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.037452:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.037467:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 43 pid: 5862 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.037482:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527843840:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359983.037788:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3a028c00 going to sleep for 11 seconds 00000100:00080000:2.0:1787359983.038667:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359983.040833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359983.040944:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508939392 00000100:00100000:1.0:1787359983.040956:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508939392 00010000:00010000:1.0:1787359983.041003:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 44 pid: 5862 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359983.041048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:1.0:1787359983.041058:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+44:2364:x1874182508939392:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359983.041074:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359983.041081:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 44 pid: 5862 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.041094:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 44 pid: 5862 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.041137:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359983.041142:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.041152:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.041160:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.041180:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359983.041241:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+44:2364:x1874182508939392:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 184us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.041249:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 40 00010000:00010000:0.0:1787359983.042373:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3b67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce54e expref: 43 pid: 5862 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359983.042393:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527843840:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359983.042420:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.042444:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.042450:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359983.042472:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787359983.042654:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3b7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 44 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.042670:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 43 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359983.042733:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787359983.042736:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787359983.042740:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40800, rc 0) 00000100:00100000:0.0:1787359983.042800:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+43:10401:x1874182508939264:12345-192.168.201.14@tcp:101:bash.0 Request processed in 5588us (5889us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787359983.042810:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 57 00000100:00100000:3.0:1787359983.045639:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.045788:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508939648 00000100:00100000:2.0:1787359983.045801:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508939648 00000100:00100000:2.0:1787359983.045886:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 58 00000100:00100000:2.0:1787359983.045898:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+43:10401:x1874182508939648:12345-192.168.201.14@tcp:36:bash.0 00010000:00010000:2.0:1787359983.046176:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.046195:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.046208:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787359983.046259:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787359983.046282:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000688d1b22 reply state 0000000063dac642 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.046291:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787359983.046380:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+46:10401:x1874182508939648:12345-192.168.201.14@tcp:36:bash.0 Request processed in 483us (751us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787359983.046399:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 58 00000020:00080000:2.0:1787359983.046405:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787359983.050604:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.050624:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.050632:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.050639:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359983.050645:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.050654:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.050702:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359983.050705:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359983.050711:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.050718:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3b91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.051236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359983.052095:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508939776 00000100:00100000:1.0:1787359983.052110:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508939776 00000100:00100000:1.0:1787359983.052220:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:1.0:1787359983.052234:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+45:10401:x1874182508939776:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:1.0:1787359983.052262:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359983.052285:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce563 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.052380:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.052396:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 46 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.052440:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.052486:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 46 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.052503:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 46 pid: 10018 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359983.052521:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527843968:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359983.052629:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787359983.055155:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527843968:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359983.055188:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.056588:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.056672:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508939904 00000100:00100000:2.0:1787359983.056726:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508939904 00010000:00010000:2.0:1787359983.056773:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 47 pid: 10018 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.056843:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:2.0:1787359983.056855:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:2363:x1874182508939904:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787359983.056874:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359983.056883:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 47 pid: 10018 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.056897:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 47 pid: 10018 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.056922:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3b83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce55c expref: 47 pid: 10018 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.056938:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359983.056944:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.056954:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.056962:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.056996:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359983.057055:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+46:2363:x1874182508939904:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 202us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.057064:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 41 00010000:00010000:1.0:1787359983.057137:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.057146:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359983.057193:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787359983.057198:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359983.057220:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.057251:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3b98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce563 expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.057280:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce563 expref: 45 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.057288:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359983.057291:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787359983.057293:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3400, rc 0) 00000100:00100000:1.0:1787359983.057318:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+45:10401:x1874182508939776:12345-192.168.201.14@tcp:101:bash.0 Request processed in 5087us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.057325:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:3.0:1787359983.060314:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359983.060386:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508940160 00000100:00100000:1.0:1787359983.060398:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508940160 00000100:00100000:1.0:1787359983.060461:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:1.0:1787359983.060471:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1113bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+45:10401:x1874182508940160:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:1.0:1787359983.060722:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1113bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+46:10401:x1874182508940160:12345-192.168.201.14@tcp:35:bash.0 Request processed in 251us (416us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787359983.060730:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:3.0:1787359983.124606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.124757:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508940416 00000100:00100000:2.0:1787359983.124778:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508940416 00000100:00100000:2.0:1787359983.124850:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:2.0:1787359983.124861:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+46:10412:x1874182508940416:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787359983.124887:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359983.124908:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce56a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359983.125189:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787359983.125286:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3ba6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce56a expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.125300:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:2.0:1787359983.125302:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787359983.125306:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef3ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce56a expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.125317:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347600, rc 0) 00000100:00100000:2.0:1787359983.125371:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10412:x1874182508940416:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 512us (811us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787359983.125376:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:0.0:1787359983.133649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.137351:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508940544 00000100:00100000:2.0:1787359983.137367:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508940544 00000100:00100000:2.0:1787359983.138364:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 61 00000100:00100000:2.0:1787359983.138382:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10412:x1874182508940544:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:2.0:1787359983.138470:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138490:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138517:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138535:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138542:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138548:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138665:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138675:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138709:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787359983.138753:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138766:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138773:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138780:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138796:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359983.138801:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138808:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138823:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:2.0:1787359983.138825:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359983.138830:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138836:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138849:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138855:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138861:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138866:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359983.138869:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138875:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138894:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d25919600) 00010000:00010000:2.0:1787359983.138897:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359983.138899:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138905:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138920:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138926:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138931:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138936:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359983.138939:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138944:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138951:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359983.138953:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359983.138956:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.138961:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359983.139351:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10412:x1874182508940544:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 971us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.139360:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 61 00000100:00100000:3.0:1787359983.142556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359983.143215:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508940800 00000100:00100000:1.0:1787359983.143226:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508940800 00000100:00100000:1.0:1787359983.143279:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787359983.143290:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10412:x1874182508940800:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787359983.143529:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+48:10412:x1874182508940800:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 240us (983us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787359983.143538:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:0.0:1787359983.169996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359983.170189:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508941056 00000100:00100000:1.0:1787359983.170212:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508941056 00000100:00100000:1.0:1787359983.170270:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:1.0:1787359983.170283:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+48:10415:x1874182508941056:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359983.170307:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359983.170333:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3bc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce571 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170409:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170422:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170433:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170448:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170455:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170461:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170595:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170605:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170612:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359983.170630:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787359983.170765:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170772:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170778:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170783:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359983.170788:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170795:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170808:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359983.170811:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359983.170815:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170822:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3bd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170834:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170840:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170856:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170861:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359983.170864:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170870:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170878:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d20336400) 00010000:00010000:1.0:1787359983.170880:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359983.170884:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170890:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef3bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170936:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3bc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce571 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170951:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce571 expref: 50 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.170958:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359983.170960:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787359983.170963:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2000, rc 0) 00000100:00100000:1.0:1787359983.171044:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10415:x1874182508941056:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 762us (1057us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787359983.171060:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:0.0:1787359983.173417:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359983.173509:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508941184 00000100:00100000:3.0:1787359983.173521:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508941184 00000100:00100000:3.0:1787359983.173603:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:3.0:1787359983.173615:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10415:x1874182508941184:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:3.0:1787359983.173706:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173724:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173736:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173764:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173772:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173778:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173785:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359983.173789:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173797:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173810:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:3.0:1787359983.173813:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787359983.173942:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.173950:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359983.174029:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10415:x1874182508941184:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 415us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.174038:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:3.0:1787359983.176669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359983.176932:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.177035:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508941568 00000100:00100000:2.0:1787359983.177046:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508941568 00000100:00100000:2.0:1787359983.177113:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:2.0:1787359983.177124:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10415:x1874182508941568:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787359983.177362:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:10415:x1874182508941568:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 239us (430us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787359983.177370:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:1.0:1787359983.178350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508941312 00000100:00100000:1.0:1787359983.178360:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508941312 00000100:00100000:1.0:1787359983.178435:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:1.0:1787359983.178444:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:2365:x1874182508941312:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359983.178459:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359983.178487:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3bde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce571 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.178508:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:1.0:1787359983.178514:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359983.179012:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:2365:x1874182508941312:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 567us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.179020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:3.0:1787359983.299657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.299905:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508941824 00000100:00100000:2.0:1787359983.299918:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508941824 00000100:00100000:2.0:1787359983.300042:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:2.0:1787359983.300054:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10433:x1874182508941824:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:2.0:1787359983.300084:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359983.300110:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce578 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.300225:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.300241:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.300252:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359983.300282:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787359983.300420:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef3bf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce578 expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.300440:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce578 expref: 52 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.300450:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359983.300452:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787359983.300456:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346200, rc 0) 00000100:00100000:2.0:1787359983.300600:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10433:x1874182508941824:12345-192.168.201.14@tcp:101:cat.0 Request processed in 547us (953us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787359983.300610:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:0.0:1787359983.320990:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359983.321124:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508941952 00000100:00100000:3.0:1787359983.321137:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508941952 00000100:00100000:3.0:1787359983.321211:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:3.0:1787359983.321225:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10434:x1874182508941952:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359983.321254:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359983.321280:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce57f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.321356:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.321372:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.321384:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359983.321448:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787359983.321464:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359983.321495:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.321525:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce57f expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.321547:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce57f expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.321577:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359983.321581:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787359983.321585:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63e00, rc 0) 00000100:00100000:3.0:1787359983.321665:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10434:x1874182508941952:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 442us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.321672:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:0.0:1787359983.325794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.325908:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508942336 00000100:00100000:2.0:1787359983.325921:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508942336 00000100:00100000:2.0:1787359983.325990:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:2.0:1787359983.326002:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10434:x1874182508942336:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787359983.326335:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10434:x1874182508942336:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 334us (551us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787359983.326344:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:0.0:1787359983.328249:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359983.328348:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508942464 00000100:00100000:2.0:1787359983.328358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508942464 00000100:00100000:2.0:1787359983.328425:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:2.0:1787359983.328445:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10434:x1874182508942464:12345-192.168.201.14@tcp:103:lfs.0 00010000:00010000:2.0:1787359983.328461:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787359983.328504:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce563 expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.328526:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3bfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce578 expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.328538:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce524 expref: 52 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359983.328548:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787359983.328879:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359983.328931:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:10434:x1874182508942464:12345-192.168.201.14@tcp:103:lfs.0 Request processed in 487us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359983.328940:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:3.0:1787359983.330629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359983.330721:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508942592 00000100:00100000:1.0:1787359983.330732:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508942592 00000100:00100000:1.0:1787359983.330794:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:1.0:1787359983.330805:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:10434:x1874182508942592:12345-192.168.201.14@tcp:58:lfs.0 00010000:00010000:1.0:1787359983.330944:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.330962:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359983.330976:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787359983.331255:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787359983.331403:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787359983.331460:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787359983.331550:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:10434:x1874182508942592:12345-192.168.201.14@tcp:58:lfs.0 Request processed in 745us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359983.331568:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:0.0:1787359983.353179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359983.353265:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508942720 00000100:00100000:3.0:1787359983.353279:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508942720 00000100:00100000:3.0:1787359983.353346:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 67 00000100:00100000:3.0:1787359983.353358:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:10436:x1874182508942720:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359983.353380:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359983.353403:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce586 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353494:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353510:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353536:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353553:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353578:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353586:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353716:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353725:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353733:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359983.353769:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787359983.353773:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359983.353792:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353803:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353823:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353840:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353846:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353851:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359983.353856:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353864:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353877:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359983.353880:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359983.353885:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353891:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353905:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353910:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353915:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353919:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359983.353928:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353933:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353941:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d0947c700) 00010000:00010000:3.0:1787359983.353943:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359983.353946:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353951:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353983:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.353997:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359983.354004:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:3.0:1787359983.354006:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787359983.354009:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63a00, rc 0) 00000100:00100000:3.0:1787359983.354069:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10436:x1874182508942720:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 712us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359983.354076:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 67 00000100:00100000:3.0:1787359983.526997:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527844096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359983.527077:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359983.527221:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527844096 00000100:00100000:0.0:1787359983.527232:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527844096 00000100:00100000:0.0:1787359983.527291:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787359983.527302:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527844096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787359983.527346:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359983.527411:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527844096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359983.527419:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787359983.527574:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527844096:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787359983.654954:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787359983.975908:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787359983.975917:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787359983.975964:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787359983.975972:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787359983.976128:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527844224:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787359983.976231:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787359983.981079:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527844224:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787359984.001867:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.001935:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508942848 00000100:00100000:1.0:1787359984.001950:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508942848 00000100:00100000:1.0:1787359984.002035:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:1.0:1787359984.002048:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508942848:12345-192.168.201.14@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787359984.002152:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508942848:12345-192.168.201.14@tcp:900:lhsmtool_posix.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.002161:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:3.0:1787359984.003978:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.004054:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508942976 00000100:00100000:2.0:1787359984.004065:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508942976 00000100:00100000:2.0:1787359984.004137:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 68 00000100:00100000:2.0:1787359984.004147:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508942976:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787359984.004181:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787359984.004286:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508942976:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.004294:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 68 00000100:00100000:2.0:1787359984.017671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.017853:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508943104 00000100:00100000:1.0:1787359984.017866:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508943104 00000100:00100000:1.0:1787359984.017936:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:1.0:1787359984.017949:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508943104:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787359984.018207:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018235:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018253:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018273:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018280:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018287:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018316:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018326:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018332:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359984.018375:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787359984.018379:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359984.018394:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018406:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018424:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018431:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018438:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359984.018443:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018451:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018466:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:1.0:1787359984.018470:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359984.018475:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018482:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018495:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018501:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018507:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018512:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359984.018524:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018530:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018538:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff983d20336500) 00010000:00010000:1.0:1787359984.018540:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359984.018558:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018565:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c40 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018584:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018590:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018596:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018601:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359984.018604:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018610:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018618:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:1.0:1787359984.018620:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359984.018630:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.018636:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef3c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.021283:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508943104:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 Request processed in 3323us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.021298:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:2.0:1787359984.038436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.038519:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508943360 00000100:00100000:3.0:1787359984.038533:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508943360 00000100:00100000:3.0:1787359984.038613:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:3.0:1787359984.038625:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10447:x1874182508943360:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359984.038649:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.038671:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce58d expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038805:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038822:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038835:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359984.038848:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787359984.038946:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038953:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038960:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038966:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359984.038983:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.038990:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.039006:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:3.0:1787359984.039009:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787359984.039013:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.039021:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.039066:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c4e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce58d expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.039092:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:3.0:1787359984.039094:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787359984.039098:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce58d expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.039108:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62000, rc 0) 00000100:00100000:3.0:1787359984.039178:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10447:x1874182508943360:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 555us (752us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787359984.039186:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:3.0:1787359984.047823:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.047982:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508943488 00000100:00100000:1.0:1787359984.048010:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508943488 00000100:00100000:1.0:1787359984.048085:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 71 00000100:00100000:1.0:1787359984.048098:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10447:x1874182508943488:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787359984.048140:0:10018:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787359984.048259:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10447:x1874182508943488:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 163us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.048267:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 71 00000100:00100000:1.0:1787359984.060816:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.061175:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508943744 00000100:00100000:3.0:1787359984.061191:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508943744 00000100:00100000:3.0:1787359984.061266:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 72 00000100:00100000:3.0:1787359984.061285:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10447:x1874182508943744:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359984.061311:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.061315:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787359984.061346:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce57f expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.061364:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359984.061369:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359984.061385:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce594 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787359984.065195:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787359984.065504:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.065524:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.065539:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.068889:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce594 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.068914:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce594 expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.068927:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d0947c700) 00010000:00010000:3.0:1787359984.068930:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787359984.068941:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62600, rc 0) 00000100:00100000:3.0:1787359984.069029:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10447:x1874182508943744:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 7745us (8222us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787359984.069039:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 72 00000100:00100000:0.0:1787359984.082969:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.083951:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508944000 00000100:00100000:3.0:1787359984.083967:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508944000 00000100:00100000:3.0:1787359984.084042:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 73 00000100:00100000:3.0:1787359984.084054:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10447:x1874182508944000:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787359984.084117:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359984.084150:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce594 expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084169:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d0947c700) 00010000:00010000:3.0:1787359984.084179:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359984.084202:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084215:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084225:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084239:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084246:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084252:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084331:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084338:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084344:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084350:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359984.084355:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084363:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084370:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359984.084373:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359984.084376:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084382:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3c78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084391:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084396:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084402:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084425:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359984.084428:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084434:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084442:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfaa6dc49 (ffff983d0947c100) 00010000:00010000:3.0:1787359984.084444:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359984.084446:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.084452:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfaa6dc49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.084534:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10447:x1874182508944000:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 481us (1573us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787359984.084552:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 73 00000100:00100000:3.0:1787359984.088641:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.088777:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508944128 00000100:00100000:2.0:1787359984.088789:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508944128 00000100:00100000:2.0:1787359984.088886:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:2.0:1787359984.088898:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10447:x1874182508944128:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787359984.088926:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359984.088952:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef3c86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce59b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.089003:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.089020:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.089032:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.089138:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef3c86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.089157:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.089166:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:2.0:1787359984.089168:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787359984.089172:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346600, rc 0) 00000100:00100000:2.0:1787359984.089240:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10447:x1874182508944128:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 343us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.089247:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:3.0:1787359984.098174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.098254:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508944384 00000100:00100000:1.0:1787359984.098267:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508944384 00000100:00100000:1.0:1787359984.098333:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:1.0:1787359984.098344:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10447:x1874182508944384:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787359984.098437:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.098457:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.098470:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787359984.098794:0:10018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787359984.098804:0:10018:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358427126189ns, next at 359427124004ns, rc = 0 00000004:00010000:1.0:1787359984.098890:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9974349 reply state 00000000b1203976 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.098900:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787359984.099000:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10447:x1874182508944384:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 656us (835us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787359984.099008:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 75 00010000:00010000:3.0:1787359984.100884:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.100902:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.100910:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.100915:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359984.100928:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.100937:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.100957:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:3.0:1787359984.100961:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787359984.100966:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.100973:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3c94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.101632:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.101729:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508944512 00000100:00100000:1.0:1787359984.101742:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508944512 00000100:00100000:1.0:1787359984.101811:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:1.0:1787359984.101824:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10447:x1874182508944512:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787359984.101851:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359984.101872:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5a2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.101938:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.101952:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.101968:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:1.0:1787359984.101971:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787359984.101973:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3000, rc 0) 00000100:00100000:1.0:1787359984.102037:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10447:x1874182508944512:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 215us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.102044:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:1.0:1787359984.104662:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.104828:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508944640 00000100:00100000:3.0:1787359984.104840:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508944640 00000100:00100000:3.0:1787359984.104890:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 24 00000100:00100000:3.0:1787359984.104901:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182508944640:12345-192.168.201.14@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787359984.104940:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1787359984.104971:0:6700:0:(genops.c:1385:class_connect()) connect: client 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430, cookie 0x72f6de40e4ef3ca2 00002000:00100000:3.0:1787359984.104983:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430/ffff983d0321e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787359984.105006:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787359984.105252:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787359984.105288:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983d0321b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787359984.107619:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2361:x1874182508944640:12345-192.168.201.14@tcp:8:lhsmtool_posix.0 Request processed in 2707us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.107634:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 24 00000040:00080000:2.0:1787359984.117800:0:12009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359984.117811:0:12009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787359984.117852:0:12009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787359984.117858:0:12009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787359984.125383:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.125802:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508944768 00000100:00100000:3.0:1787359984.125816:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508944768 00000100:00080000:2.0:1787359984.125859:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787359984.125900:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:3.0:1787359984.125912:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:0:x1874182508944768:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00000001:00080000:2.0:1787359984.178520:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1787359984.178537:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000100:00100000:3.0:1787359984.178858:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:0:x1874182508944768:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 52940us (53477us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787359984.178871:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:3.0:1787359984.184399:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.184576:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508945024 00000100:00100000:2.0:1787359984.184590:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508945024 00000100:00100000:2.0:1787359984.184651:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:2.0:1787359984.184662:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10447:x1874182508945024:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787359984.184951:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10447:x1874182508945024:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 289us (561us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787359984.184959:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:0.0:1787359984.189245:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.189815:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508945280 00000100:00100000:2.0:1787359984.189829:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508945280 00000100:00100000:2.0:1787359984.189901:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:2.0:1787359984.189912:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10447:x1874182508945280:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787359984.190045:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10447:x1874182508945280:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 134us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.190053:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:2.0:1787359984.200296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.201940:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508945408 00000100:00100000:3.0:1787359984.201957:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508945408 00000100:00100000:3.0:1787359984.202023:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 78 00000100:00100000:3.0:1787359984.202035:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10447:x1874182508945408:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359984.202057:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359984.202082:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5a9 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.202167:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.202183:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.202194:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359984.202233:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359984.202252:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.202287:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a9 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.202303:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a9 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.202312:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:3.0:1787359984.202314:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787359984.202318:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63e00, rc 0) 00000100:00100000:3.0:1787359984.202419:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+58:10447:x1874182508945408:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 386us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.202427:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 78 00000100:00100000:3.0:1787359984.209912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.210248:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508945536 00000100:00100000:1.0:1787359984.210261:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508945536 00000100:00100000:1.0:1787359984.210332:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:1.0:1787359984.210343:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508945536:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787359984.210365:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359984.210392:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5b0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787359984.210421:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f2ef, blocks: 0x1 00010000:00010000:1.0:1787359984.210442:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1787359984.210447:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359984.210459:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.210481:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.210496:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2600, rc 0) 00000100:00100000:1.0:1787359984.210610:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508945536:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 268us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.210618:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:0.0:1787359984.217536:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.217621:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508945792 00000100:00100000:3.0:1787359984.217635:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508945792 00000100:00100000:3.0:1787359984.217785:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:3.0:1787359984.217797:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+58:10447:x1874182508945792:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787359984.217925:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+58:10447:x1874182508945792:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 129us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.217933:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:3.0:1787359984.225607:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359984.225740:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508945920 00000100:00100000:0.0:1787359984.225752:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508945920 00000100:00100000:0.0:1787359984.225817:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:0.0:1787359984.225838:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:10447:x1874182508945920:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787359984.225860:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359984.225885:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5b7 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.225922:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.225939:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787359984.225943:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787359984.225949:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.225996:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.226011:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.226025:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1874182527844352:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359984.226127:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d094e6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.228172:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1874182527844352:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359984.228212:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.228236:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787359984.228303:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:10447:x1874182508945920:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 2474us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.228311:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:3.0:1787359984.230067:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.230136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508946048 00000100:00100000:1.0:1787359984.230148:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508946048 00010000:00010000:1.0:1787359984.230197:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.230243:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:1.0:1787359984.230255:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2007cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508946048:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359984.230274:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359984.230309:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.230325:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.230350:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3cb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b0 expref: 7 pid: 6701 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.230369:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359984.230373:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359984.230384:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.230395:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.230441:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.230477:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1874182527844480:192.168.201.14@tcp:105: 00000100:00100000:1.0:1787359984.230576:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359984.233989:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1874182527844480:192.168.201.14@tcp:105: 00010000:00010000:1.0:1787359984.234023:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359984.234081:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2007cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508946048:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 3826us (4019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.234092:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:3.0:1787359984.239775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.240288:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508946176 00000100:00100000:1.0:1787359984.240301:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508946176 00002000:00100000:1.0:1787359984.240354:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff983d39cc3100 x1874182508946176/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:175/0 lens 504/0 e 0 to 0 dl 1787359995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787359984.240366:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d39cc3100 with x1874182508946176 ext(0->8) 00002000:00010000:1.0:1787359984.240372:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d39cc3100 00000100:00100000:1.0:1787359984.240407:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:1.0:1787359984.240419:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508946176:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787359984.243607:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508946176:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 Request processed in 3180us (3833us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787359984.243622:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00002000:00100000:1.0:1787359984.243636:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff983d39cc3100 x1874182508946176/t4294967302(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:175/0 lens 504/448 e 0 to 0 dl 1787359995 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787359984.243647:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d39cc3100 with x1874182508946176 ext(0->8) 00002000:00010000:1.0:1787359984.243653:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d39cc3100 00000100:00100000:3.0:1787359984.255357:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.255589:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508946304 00000100:00100000:2.0:1787359984.255603:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508946304 00000100:00100000:2.0:1787359984.255705:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:2.0:1787359984.255720:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+58:10447:x1874182508946304:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787359984.332134:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000001:00080000:3.0:1787359984.332173:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1787359984.332178:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:3.0:1787359984.332243:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787359984.332263:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787359984.332277:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d20054240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787359984.332282:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d18135500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d20054600 00000020:00080000:3.0:1787359984.332285:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d3f11e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d3fbe7400 00000100:00100000:3.0:1787359984.332514:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527844608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787359984.332601:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.333087:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10447:x1874182508946304:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 Request processed in 77367us (77738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.333099:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 80 00000020:00080000:2.0:1787359984.333208:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787359984.333338:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787359984.333355:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527844608 00000100:00100000:2.0:1787359984.333364:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527844608 00000100:00100000:0.0:1787359984.333600:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527844736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787359984.333648:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359984.336075:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527844736 00000100:00100000:2.0:1787359984.336092:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527844736 00000100:00100000:3.0:1787359984.336207:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787359984.336223:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527844608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787359984.336517:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787359984.336521:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787359983 00002000:00010000:3.0:1787359984.336525:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787359984.336528:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787359983 -> 1787359983 00002000:00010000:3.0:1787359984.336531:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787359984.337086:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527844608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 867us (4485us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787359984.337097:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787359984.337126:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787359984.337135:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1874182527844736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787359984.337158:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787359984.337190:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a88f2ed, atime: 0x6a88f2ed, ctime: 0x6a88f2ed, blocks: 0x1 00010000:00010000:3.0:1787359984.337200:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.337239:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:3.0:1787359984.337244:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359984.337252:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.337272:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.337284:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.337292:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.337475:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787359984.338162:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1874182527844736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1027us (4511us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787359984.338171:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787359984.338655:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d0643ea00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787359984.338664:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527844608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787359984.338725:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f194700/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787359984.338730:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527844736:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787359984.339147:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359984.339158:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.339169:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359984.339174:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.339184:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.339210:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.339217:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3cc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.339239:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359984.339240:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359984.339242:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359984.341128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.341244:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508946432 00000100:00100000:2.0:1787359984.341259:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508946432 00000100:00100000:2.0:1787359984.341327:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:2.0:1787359984.341338:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508946432:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787359984.378081:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1787359984.378116:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1787359984.378350:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508946432:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 Request processed in 37006us (37223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.378363:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:0.0:1787359984.381660:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.381946:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508946688 00000100:00100000:3.0:1787359984.381960:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508946688 00000100:00100000:3.0:1787359984.382075:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:3.0:1787359984.382088:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10447:x1874182508946688:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787359984.382163:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359984.382195:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a9 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.382216:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:3.0:1787359984.382221:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359984.382253:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.382269:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.382281:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787359984.382558:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004df91d47 reply state 0000000063365e23 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.382579:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787359984.382735:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:10447:x1874182508946688:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 648us (1082us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787359984.382742:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 81 00010000:00010000:2.0:1787359984.386262:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.386281:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.386288:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.386295:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359984.386300:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.386309:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.386330:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:2.0:1787359984.386334:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359984.386339:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.386345:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3ccc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.386432:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359984.387326:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508946816 00000100:00100000:3.0:1787359984.387342:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508946816 00000100:00100000:3.0:1787359984.387509:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:3.0:1787359984.387522:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508946816:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787359984.388218:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787359984.388223:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787359983 -> 1787359982 00002000:00010000:2.0:1787359984.388226:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787359981 00002000:00010000:2.0:1787359984.388229:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787359983 -> 1787359982 00002000:00010000:2.0:1787359984.388231:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787359984.388307:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508946816:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 787us (1877us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787359984.388316:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:3.0:1787359984.390594:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359984.391175:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947072 00000100:00100000:1.0:1787359984.391188:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947072 00000100:00100000:1.0:1787359984.391262:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 82 00000100:00100000:1.0:1787359984.391275:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10447:x1874182508947072:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787359984.391359:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.391379:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.391494:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.391553:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.391570:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 13 pid: 5863 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.391587:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527844864:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359984.392107:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.395756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359984.396296:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947200 00000100:00100000:0.0:1787359984.396309:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947200 00010000:00010000:0.0:1787359984.396360:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 14 pid: 5863 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.396417:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:0.0:1787359984.396429:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:2363:x1874182508947200:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359984.396446:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359984.396455:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 14 pid: 5863 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.396470:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 14 pid: 5863 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.396498:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:0.0:1787359984.396504:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.396515:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.396549:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.396584:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359984.396644:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:2363:x1874182508947200:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 216us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.396652:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 43 00010000:00010000:1.0:1787359984.398189:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce59b expref: 13 pid: 5863 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.398213:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527844864:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359984.398242:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398307:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398315:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398347:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398354:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398361:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398366:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359984.398372:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398380:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398395:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:0.0:1787359984.398466:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787359984.398472:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.398479:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.398722:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:10447:x1874182508947072:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 Request processed in 7449us (8136us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787359984.398734:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 82 00000100:00100000:3.0:1787359984.402307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.402528:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947328 00000100:00100000:2.0:1787359984.402551:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947328 00000100:00100000:2.0:1787359984.402624:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:2.0:1787359984.402637:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508947328:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787359984.403012:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.403041:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.403052:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787359984.403056:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787359984.403062:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.403137:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.403169:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.403186:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1874182527844992:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359984.403285:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d012ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.406843:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359984.407131:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947456 00000100:00100000:0.0:1787359984.407143:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947456 00010000:00010000:0.0:1787359984.407190:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 8 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.407239:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:0.0:1787359984.407252:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2364:x1874182508947456:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359984.407270:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359984.407298:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 8 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.407315:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 8 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.407344:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787359984.407349:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787359984.407358:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.407387:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.407414:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359984.407482:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2364:x1874182508947456:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 231us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359984.407490:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 44 00010000:00010000:2.0:1787359984.407820:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef3cbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5b7 expref: 7 pid: 6698 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.407953:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1874182527844992:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787359984.407989:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408001:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408009:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408037:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408046:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408066:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408073:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787359984.408078:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408088:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408100:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.408107:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095a91b54/0x72f6de40e4ef3cda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.408161:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508947328:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 Request processed in 5527us (5866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.408170:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:3.0:1787359984.411430:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.411518:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947712 00000100:00100000:2.0:1787359984.411530:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947712 00000100:00100000:2.0:1787359984.411620:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 83 00000100:00100000:2.0:1787359984.411632:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:10447:x1874182508947712:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787359984.411754:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.411789:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.411815:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.412058:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.412070:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.412078:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.412116:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.412131:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 13 pid: 5861 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.412146:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527845120:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359984.412234:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d012ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.415644:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.415783:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527845120:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787359984.415823:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.416961:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947840 00000100:00100000:0.0:1787359984.416975:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947840 00010000:00010000:1.0:1787359984.417113:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 14 pid: 5861 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359984.417202:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:1.0:1787359984.417214:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:2363:x1874182508947840:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359984.417232:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359984.417240:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 14 pid: 5861 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.417270:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 14 pid: 5861 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.417294:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5a2 expref: 14 pid: 5861 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.417311:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:1.0:1787359984.417317:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.417326:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.417335:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359984.417367:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359984.417438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:2363:x1874182508947840:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 225us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359984.417446:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 45 00010000:00010000:3.0:1787359984.417509:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.417517:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787359984.417757:0:10018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787359984.417938:0:10018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787359984.417993:0:10018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787359984.418083:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d39cc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10018:1874182527845248:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787359984.418168:0:10018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.418207:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.418249:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527845248 00000100:00100000:3.0:1787359984.418256:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527845248 00000100:00100000:3.0:1787359984.418291:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359984.418298:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10018:x1874182527845248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787359984.418368:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10018:x1874182527845248:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359984.418376:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787359984.418414:0:10018:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787359984.418421:0:10018:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d0643ea00, transno 4294967303 00000100:00100000:3.0:1787359984.418432:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d39cc3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10018:1874182527845248:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787359984.418945:0:10018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787359984.419002:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10018:1874182527845376:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787359984.419036:0:10018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359984.419064:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08240 going to sleep for 11 seconds 00000100:00100000:3.0:1787359984.419082:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527845376 00000100:00100000:3.0:1787359984.419087:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527845376 00000100:00100000:3.0:1787359984.419111:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359984.419117:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10018:x1874182527845376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787359984.419284:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10018:x1874182527845376:12345-0@lo:1000:mdt00_003.0 Request processed in 166us (247us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787359984.419292:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787359984.419327:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10018:1874182527845376:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787359984.419356:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419366:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419374:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419381:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359984.419386:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419394:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419411:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919600) 00010000:00010000:3.0:1787359984.419414:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787359984.419420:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419426:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef3ce8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419476:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419483:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419490:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419495:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359984.419498:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419504:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419512:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:3.0:1787359984.419515:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787359984.419517:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419523:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3c16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419561:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419575:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419584:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419619:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359984.419633:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 16 pid: 5862 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.419644:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527845504:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787359984.419734:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08240 going to sleep for 11 seconds 00000100:00100000:0.0:1787359984.424192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.424408:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508947968 00000100:00100000:2.0:1787359984.424431:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508947968 00010000:00010000:2.0:1787359984.424477:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 17 pid: 5862 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359984.424521:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:2.0:1787359984.424533:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:2362:x1874182508947968:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787359984.424560:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359984.424579:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 17 pid: 5862 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.424593:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 17 pid: 5862 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.424617:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:2.0:1787359984.424623:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.424634:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.424643:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.424665:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359984.424753:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:2362:x1874182508947968:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 221us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359984.424761:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 46 00010000:00010000:3.0:1787359984.426375:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce586 expref: 16 pid: 5862 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359984.426398:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527845504:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359984.426495:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.426928:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.426937:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.426949:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.426956:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.426962:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.426968:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359984.426973:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427001:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427017:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:0.0:1787359984.427021:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359984.427026:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427032:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3cef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427045:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427051:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427057:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427063:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359984.427066:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427071:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427079:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336400) 00010000:00010000:0.0:1787359984.427081:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787359984.427083:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.427099:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef3ce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359984.427384:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10447:x1874182508947712:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 15752us (15963us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787359984.427395:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 83 00000020:00080000:0.0:1787359984.427410:0:10018:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787359984.429205:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787359984.429214:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787359984.429271:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787359984.429279:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787359984.431396:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359984.431564:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508948224 00000100:00100000:2.0:1787359984.431587:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508948224 00000100:00100000:2.0:1787359984.431706:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:2.0:1787359984.431720:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10447:x1874182508948224:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787359984.433048:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787359984.433157:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787359984.433212:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.433232:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.433244:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.433256:0:5865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.433263:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.433270:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359984.433299:0:5865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787359984.433652:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359984.433661:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.433670:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787359984.433711:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.433721:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.433737:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff983d25919c00) 00010000:00010000:0.0:1787359984.433740:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787359984.433745:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.433752:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef3cf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359984.433772:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359984.433775:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359984.433777:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359984.433980:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:10447:x1874182508948224:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 2258us (2590us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787359984.433991:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00000020:00080000:2.0:1787359984.433998:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787359984.678988:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359985.584781:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527845632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359985.584857:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359985.585104:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527845632 00000100:00100000:0.0:1787359985.585116:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527845632 00000100:00100000:0.0:1787359985.585192:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787359985.585204:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527845632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359985.585244:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359985.585296:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527845632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359985.585316:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787359985.585371:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527845632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787359985.585527:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787359985.703835:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787359986.008385:0:12060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787359986.008395:0:12060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787359986.008436:0:12060:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787359986.008442:0:12060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787359986.133642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.133760:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508948480 00000100:00100000:0.0:1787359986.133774:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508948480 00000100:00100000:0.0:1787359986.133852:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:0.0:1787359986.133865:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:10465:x1874182508948480:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359986.133894:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.133918:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5be expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.134184:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.134202:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.134215:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359986.134235:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787359986.134423:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5be expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.134439:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5be expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.134448:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359986.134450:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787359986.134454:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40800, rc 0) 00000100:00100000:0.0:1787359986.134521:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:10465:x1874182508948480:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 659us (889us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787359986.134528:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00080000:3.0:1787359986.134796:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359986.137727:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.137822:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508948608 00000100:00100000:1.0:1787359986.137834:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508948608 00000100:00100000:1.0:1787359986.137890:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:1.0:1787359986.137910:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:10465:x1874182508948608:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:1.0:1787359986.137993:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138012:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138022:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138037:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138044:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138049:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138328:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138337:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138357:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787359986.138395:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138407:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138418:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138425:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138431:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.138436:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138443:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138455:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359986.138458:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.138463:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138470:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138483:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138489:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138494:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138499:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.138517:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138524:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138533:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d20336d00) 00010000:00010000:1.0:1787359986.138535:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.138538:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138544:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138558:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138564:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138570:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138574:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.138577:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138583:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138589:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359986.138591:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.138598:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.138604:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.138700:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:10465:x1874182508948608:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 771us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.138709:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:1.0:1787359986.162373:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.169816:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508948864 00000100:00100000:3.0:1787359986.169833:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508948864 00000100:00100000:3.0:1787359986.169904:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 86 00000100:00100000:3.0:1787359986.169917:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:10468:x1874182508948864:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359986.169941:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359986.169977:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5c5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170069:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170086:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170098:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170113:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170120:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170127:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170453:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170462:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.170469:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359986.170478:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787359986.172554:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172583:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172590:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172597:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359986.172602:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172611:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172629:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359986.172633:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359986.172639:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172646:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172669:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172692:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172698:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172704:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359986.172714:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172721:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172730:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d0947c000) 00010000:00010000:3.0:1787359986.172733:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359986.172736:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172743:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3d35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172802:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172818:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.172826:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359986.172828:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787359986.172831:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62000, rc 0) 00000100:00100000:3.0:1787359986.172908:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10468:x1874182508948864:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 2993us (10544us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787359986.172931:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 86 00000100:00100000:0.0:1787359986.176772:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.178513:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508948992 00000100:00100000:3.0:1787359986.178529:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508948992 00000100:00100000:3.0:1787359986.178596:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 87 00000100:00100000:3.0:1787359986.178609:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10468:x1874182508948992:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:3.0:1787359986.178716:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178734:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178746:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178775:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178782:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178789:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178795:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359986.178800:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178807:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178820:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359986.178823:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787359986.178828:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.178834:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.179171:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10468:x1874182508948992:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 313us (2157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.179182:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 87 00000100:00100000:3.0:1787359986.181718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.182524:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508949248 00000100:00100000:1.0:1787359986.182539:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508949248 00000100:00100000:1.0:1787359986.182600:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:1.0:1787359986.182612:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d11139c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10468:x1874182508949248:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787359986.182854:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d11139c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:10468:x1874182508949248:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 244us (1144us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787359986.182862:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:3.0:1787359986.247672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.248886:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508949504 00000100:00100000:0.0:1787359986.248902:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508949504 00000100:00100000:0.0:1787359986.248978:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 88 00000100:00100000:0.0:1787359986.248990:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:9988:x1874182508949504:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787359986.249020:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.249046:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3d51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5cc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.249156:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.249173:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.249200:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.249240:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.249254:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 23 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.249268:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527845760:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359986.249367:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d13608cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359986.254023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.254143:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527845760:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359986.254179:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.254257:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508949632 00000100:00100000:3.0:1787359986.254267:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508949632 00010000:00010000:3.0:1787359986.254373:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 24 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.254425:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:3.0:1787359986.254437:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:2363:x1874182508949632:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359986.254452:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359986.254460:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 24 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.254474:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 24 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.254497:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5c5 expref: 24 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.254525:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359986.254531:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.254541:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.254561:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.254588:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359986.254638:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.254647:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:2363:x1874182508949632:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 210us (634us total) trans 0 rc 0/0 00010000:00010000:0.0:1787359986.254650:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.254659:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 47 00000004:00200000:0.0:1787359986.254697:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787359986.255057:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3d51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.255076:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.255098:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:0.0:1787359986.255101:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787359986.255104:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41800, rc 0) 00000100:00100000:0.0:1787359986.255143:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:9988:x1874182508949504:12345-192.168.201.14@tcp:101:bash.0 Request processed in 6156us (7481us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787359986.255151:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 88 00000100:00100000:2.0:1787359986.263538:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.263657:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508949888 00000100:00100000:3.0:1787359986.263671:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508949888 00000100:00100000:2.0:1787359986.263893:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 89 00000100:00100000:2.0:1787359986.263907:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:9988:x1874182508949888:12345-192.168.201.14@tcp:36:bash.0 00010000:00010000:2.0:1787359986.264203:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.264221:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.264230:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787359986.264274:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787359986.264291:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9a4ccb1 reply state 000000005f514143 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.264297:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787359986.264328:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787359986.264432:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:9988:x1874182508949888:12345-192.168.201.14@tcp:36:bash.0 Request processed in 528us (903us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787359986.264440:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 89 00000020:00080000:2.0:1787359986.264445:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787359986.268842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.269010:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508950016 00000100:00100000:0.0:1787359986.269024:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508950016 00000100:00100000:0.0:1787359986.269094:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 90 00000100:00100000:0.0:1787359986.269106:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:9988:x1874182508950016:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787359986.269133:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.269156:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3d6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5d3 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.269224:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3d6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5d3 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.269240:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3d6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5d3 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.269263:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:0.0:1787359986.269266:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787359986.269271:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41200, rc 0) 00000100:00100000:0.0:1787359986.269346:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:9988:x1874182508950016:12345-192.168.201.14@tcp:101:bash.0 Request processed in 234us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359986.269377:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 90 00010000:00010000:1.0:1787359986.270199:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.270210:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.270217:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.270223:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.270228:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.270252:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.270266:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:1.0:1787359986.270269:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.270272:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.270278:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3d66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.273111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.273956:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508950144 00000100:00100000:2.0:1787359986.273970:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508950144 00000100:00100000:2.0:1787359986.274056:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:2.0:1787359986.274070:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:9988:x1874182508950144:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787359986.274091:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359986.274119:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5da expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787359986.274148:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a88f2ee, atime: 0x6a88f2ed, ctime: 0x6a88f2ee, blocks: 0xb 00010000:00010000:2.0:1787359986.274173:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787359986.274191:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787359986.274202:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.274224:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.274239:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346a00, rc 0) 00000100:00100000:2.0:1787359986.274308:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:9988:x1874182508950144:12345-192.168.201.14@tcp:101:bash.0 Request processed in 240us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.274315:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00080000:3.0:1787359986.275553:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359986.278629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.278981:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508950272 00000100:00100000:0.0:1787359986.278994:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508950272 00002000:00010000:0.0:1787359986.279044:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787359986.279049:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f197480 with x1874182508950272 ext(0->18446744073709551615) 00002000:00010000:0.0:1787359986.279064:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f197480. 00000100:00100000:0.0:1787359986.279103:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:0.0:1787359986.279116:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2365:x1874182508950272:12345-192.168.201.14@tcp:10:bash.0 00002000:00010000:0.0:1787359986.279597:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787359986.279602:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787359982 -> 1787359985 00002000:00010000:0.0:1787359986.279604:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787359981 -> 1787359981 00002000:00010000:0.0:1787359986.279606:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787359982 -> 1787359985 00002000:00010000:0.0:1787359986.279608:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787359986.280461:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2365:x1874182508950272:12345-192.168.201.14@tcp:10:bash.0 Request processed in 1341us (1840us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787359986.280472:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00002000:00010000:0.0:1787359986.280489:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787359986.280494:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f197480 with x1874182508950272 ext(0->18446744073709551615) 00002000:00010000:0.0:1787359986.280501:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f197480. 00000100:00100000:2.0:1787359986.348071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.348189:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508950400 00000100:00100000:1.0:1787359986.348201:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508950400 00000100:00100000:1.0:1787359986.348273:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 91 00000100:00100000:1.0:1787359986.348286:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:10482:x1874182508950400:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:1.0:1787359986.348368:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348400:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348412:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348428:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348435:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348442:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348832:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348843:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348850:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787359986.348893:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348904:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348911:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348918:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348925:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.348930:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348938:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348951:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359986.348954:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.348959:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348972:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef3d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348986:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348993:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.348999:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349004:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.349007:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349013:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349020:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d20336000) 00010000:00010000:1.0:1787359986.349023:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.349026:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349032:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3d82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349049:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349055:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349067:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349071:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.349074:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349080:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349087:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:1.0:1787359986.349089:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.349092:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.349097:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.349172:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:10482:x1874182508950400:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 889us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.349182:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 91 00000100:00100000:3.0:1787359986.405148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.405291:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508950656 00000100:00100000:0.0:1787359986.405303:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508950656 00000100:00100000:0.0:1787359986.405396:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 92 00000100:00100000:0.0:1787359986.405407:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:10485:x1874182508950656:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359986.405428:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.405450:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3d90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5e1 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405569:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405586:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405599:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405617:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405624:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405630:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405980:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.405990:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406013:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359986.406023:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787359986.406116:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406124:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406136:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406142:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.406146:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406153:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406167:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359986.406170:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.406174:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406181:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406193:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406199:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406205:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406209:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.406212:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406228:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406236:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750500) 00010000:00010000:0.0:1787359986.406238:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.406241:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406246:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406285:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3d90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5e1 expref: 30 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406298:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5e1 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.406306:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:0.0:1787359986.406309:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787359986.406311:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787359986.406374:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10485:x1874182508950656:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 968us (1234us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787359986.406382:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 92 00000100:00100000:2.0:1787359986.410671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.410804:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508950784 00000100:00100000:1.0:1787359986.410816:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508950784 00000100:00100000:1.0:1787359986.410882:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 93 00000100:00100000:1.0:1787359986.410894:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10485:x1874182508950784:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:1.0:1787359986.410969:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.410987:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 29 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.411006:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.411039:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 29 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.411050:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 29 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.411061:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527845888:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359986.411138:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787359986.420001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.420104:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508951040 00000100:00100000:3.0:1787359986.420115:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508951040 00000100:00100000:1.0:1787359986.420297:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527845888:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359986.420331:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.421629:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:3.0:1787359986.421650:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:5600:x1874182508951040:12345-192.168.201.14@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787359986.422042:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:5600:x1874182508951040:12345-192.168.201.14@tcp:35:ldlm_bl.0 Request processed in 399us (2049us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787359986.422052:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:3.0:1787359986.425031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.425100:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508951168 00000100:00100000:2.0:1787359986.425112:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508951168 00010000:00010000:2.0:1787359986.425156:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 31 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.425247:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:2.0:1787359986.425259:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:2363:x1874182508951168:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787359986.425276:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359986.425283:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 31 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.425298:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 31 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.425334:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3d58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5cc expref: 31 pid: 5863 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.425363:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:2.0:1787359986.425375:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.425386:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.425394:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.425428:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359986.425486:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:2363:x1874182508951168:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 230us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.425494:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 48 00010000:00010000:3.0:1787359986.425524:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425532:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425563:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425577:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425583:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425589:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359986.425594:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425601:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425610:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359986.425613:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787359986.425617:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.425623:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3db3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.425897:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10485:x1874182508950784:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 15005us (15236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.425906:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 93 00000100:00100000:3.0:1787359986.433420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.433920:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508951424 00000100:00100000:2.0:1787359986.433933:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508951424 00000100:00100000:2.0:1787359986.434003:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:2.0:1787359986.434016:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:10485:x1874182508951424:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787359986.434321:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:10485:x1874182508951424:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 306us (910us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787359986.434329:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:0.0:1787359986.517194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.517249:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508951680 00000100:00100000:3.0:1787359986.517261:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508951680 00000100:00100000:3.0:1787359986.517380:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:3.0:1787359986.517393:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:10496:x1874182508951680:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:3.0:1787359986.517435:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359986.517458:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3dba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5e8 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.517554:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.517579:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.517592:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.517608:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.517615:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.517622:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519055:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519068:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519083:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359986.519094:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787359986.519182:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519190:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519196:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519202:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359986.519207:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519214:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519227:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:2.0:1787359986.519230:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359986.519235:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519240:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3dc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519253:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519258:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519271:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519277:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359986.519280:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519287:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519295:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d0947c000) 00010000:00010000:2.0:1787359986.519298:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359986.519301:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519307:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519355:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3dba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5e8 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519384:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5e8 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.519392:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:2.0:1787359986.519394:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359986.519396:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346800, rc 0) 00000100:00100000:2.0:1787359986.519473:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10496:x1874182508951680:12345-192.168.201.14@tcp:101:cat.0 Request processed in 2083us (2289us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787359986.519493:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:0.0:1787359986.523771:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.523905:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508951936 00000100:00100000:3.0:1787359986.523918:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508951936 00000100:00100000:3.0:1787359986.523970:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 24 00000100:00100000:3.0:1787359986.523979:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10496:x1874182508951936:12345-192.168.201.14@tcp:35:cat.0 00000100:00100000:3.0:1787359986.524216:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:10496:x1874182508951936:12345-192.168.201.14@tcp:35:cat.0 Request processed in 236us (455us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787359986.524225:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 24 00000100:00100000:3.0:1787359986.539912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.540763:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508952192 00000100:00100000:0.0:1787359986.540776:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508952192 00000100:00100000:0.0:1787359986.540887:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00100000:0.0:1787359986.540908:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:10497:x1874182508952192:12345-192.168.201.14@tcp:36:rm.0 00010000:00010000:0.0:1787359986.540972:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787359986.541002:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5e8 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541023:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5e1 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541035:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef3d6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5d3 expref: 31 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541044:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d0947c900) 00010000:00010000:0.0:1787359986.541056:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359986.541080:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541094:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541104:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541118:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541125:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541132:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541452:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541462:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.541468:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787359986.542147:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787359986.542158:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360870479661ns, next at 361870477275ns, rc = 0 00010000:00010000:0.0:1787359986.542215:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542225:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542232:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542239:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542245:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542252:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542282:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787359986.542302:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542315:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542323:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542325:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787359986.542334:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.542336:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542340:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542353:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787359986.542356:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542360:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542369:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750200) 00010000:00010000:0.0:1787359986.542372:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787359986.542375:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542383:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542386:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3deb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542406:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff983d09750200) 00010000:00010000:0.0:1787359986.542413:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542420:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787359986.542425:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542427:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542437:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542439:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3df2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542450:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.542462:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359986.542463:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.542466:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359986.542470:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787359986.542474:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542484:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359986.542487:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.542490:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.542495:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ddd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787359986.542517:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073d4d085 reply state 0000000029b74eca transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.542525:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787359986.542713:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:10497:x1874182508952192:12345-192.168.201.14@tcp:36:rm.0 Request processed in 1804us (2807us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787359986.542722:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 95 00010000:00010000:2.0:1787359986.544563:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.544577:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.544584:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.544589:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359986.544593:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.544601:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.544617:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750500) 00010000:00010000:2.0:1787359986.544620:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359986.544624:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.544630:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef3de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.571594:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.571717:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508952448 00000100:00100000:2.0:1787359986.571731:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508952448 00000100:00100000:2.0:1787359986.571804:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 96 00000100:00100000:2.0:1787359986.571818:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:10503:x1874182508952448:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787359986.571855:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359986.571894:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3df9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5ef expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572041:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572057:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572071:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572088:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572095:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572102:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787359986.572742:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787359986.572918:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572930:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572938:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572973:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572990:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.572997:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.573004:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359986.573008:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.573016:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.573030:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:2.0:1787359986.573033:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359986.573038:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.573044:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787359986.573058:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d587816b reply state 00000000a5460674 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.573068:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787359986.573098:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3df9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.573113:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.573132:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:2.0:1787359986.573134:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359986.573137:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346200, rc 0) 00000100:00100000:2.0:1787359986.573215:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:10503:x1874182508952448:12345-192.168.201.14@tcp:101:bash.0 Request processed in 1399us (1629us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787359986.573223:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 96 00000100:00100000:0.0:1787359986.575453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:1.0:1787359986.575548:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.575559:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.575565:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.575571:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.575575:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.575581:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.575596:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d25919c00) 00010000:00010000:1.0:1787359986.575599:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359986.575604:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.575610:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef3e07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.577062:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508952576 00000100:00100000:2.0:1787359986.577078:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508952576 00000100:00100000:2.0:1787359986.577205:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:2.0:1787359986.577218:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508952576:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787359986.577238:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359986.577260:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5f6 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787359986.577301:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787359986.577324:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787359986.577329:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787359986.577339:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.577360:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.577373:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346c00, rc 0) 00000100:00100000:2.0:1787359986.577448:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508952576:12345-192.168.201.14@tcp:101:bash.0 Request processed in 231us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.577466:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00080000:3.0:1787359986.577741:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787359986.579958:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.585170:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508952704 00000100:00100000:0.0:1787359986.585189:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508952704 00000100:00100000:0.0:1787359986.585259:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:0.0:1787359986.585348:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a06b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:10503:x1874182508952704:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787359986.585374:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.585399:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce5fd expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.585459:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.585469:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787359986.585473:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787359986.585479:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.585532:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.585548:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 9 pid: 6701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.585564:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1874182527846016:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359986.585694:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359986.589809:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.589978:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508952832 00000100:00100000:3.0:1787359986.589991:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508952832 00010000:00010000:3.0:1787359986.590042:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 10 pid: 6701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.590090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:3.0:1787359986.590101:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2362:x1874182508952832:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359986.590121:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359986.590156:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 10 pid: 6701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.590172:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 10 pid: 6701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.590204:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359986.590209:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359986.590220:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.590232:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.590292:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.590331:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527846144:192.168.201.14@tcp:105: 00000100:00100000:3.0:1787359986.590427:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08540 going to sleep for 11 seconds 00010000:00010000:3.0:1787359986.590467:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef3e1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5f6 expref: 10 pid: 6701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.590485:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1874182527846016:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359986.590525:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.590538:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:3.0:1787359986.590571:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a06b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:10503:x1874182508952704:12345-192.168.201.14@tcp:101:bash.0 Request processed in 5303us (10620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.590580:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:3.0:1787359986.594345:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527846144:192.168.201.14@tcp:105: 00010000:00010000:3.0:1787359986.594374:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359986.594439:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508952832:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 4338us (4649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.594449:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:3.0:1787359986.596013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.596074:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508953088 00000100:00100000:2.0:1787359986.596084:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508953088 00000100:00100000:2.0:1787359986.596134:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:2.0:1787359986.596144:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:10503:x1874182508953088:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:2.0:1787359986.596558:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:10503:x1874182508953088:12345-192.168.201.14@tcp:35:bash.0 Request processed in 415us (550us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787359986.596567:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 25 00010000:00010000:0.0:1787359986.728356:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359986.743575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.743708:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508953216 00000100:00100000:3.0:1787359986.743720:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508953216 00000100:00100000:3.0:1787359986.743942:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 97 00000100:00100000:3.0:1787359986.743955:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:10519:x1874182508953216:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359986.743996:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359986.744020:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce604 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.744090:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.744111:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.744122:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359986.744185:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787359986.744189:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359986.744213:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.744240:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce604 expref: 36 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.744260:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce604 expref: 35 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.744406:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359986.744411:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787359986.744416:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63e00, rc 0) 00000100:00100000:3.0:1787359986.744493:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10519:x1874182508953216:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 540us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.744511:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 97 00000100:00100000:0.0:1787359986.749420:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.749525:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508953472 00000100:00100000:2.0:1787359986.749538:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508953472 00000100:00100000:2.0:1787359986.749605:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 98 00000100:00100000:2.0:1787359986.749618:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:10519:x1874182508953472:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787359986.749642:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359986.749664:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3e38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce60b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.749947:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.749963:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.749974:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359986.749986:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787359986.750112:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef3e38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce60b expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.750215:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce60b expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.750226:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:2.0:1787359986.750229:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359986.750233:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347e00, rc 0) 00000100:00100000:2.0:1787359986.750402:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:10519:x1874182508953472:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 786us (991us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787359986.750410:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 98 00000100:00100000:1.0:1787359986.754737:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.754775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.754872:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508953728 00000100:00100000:0.0:1787359986.754885:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508953728 00000100:00100000:0.0:1787359986.754960:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00100000:0.0:1787359986.754972:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:10519:x1874182508953728:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359986.755000:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.755039:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce612 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.755151:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.755166:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.755178:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359986.755189:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787359986.755301:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce612 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.755318:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce612 expref: 39 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.755327:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:0.0:1787359986.755330:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787359986.755334:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787359986.755404:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:10519:x1874182508953728:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 433us (674us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787359986.755411:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00100000:2.0:1787359986.755721:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508953856 00000100:00100000:2.0:1787359986.755727:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508953856 00000100:00100000:2.0:1787359986.755764:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:2.0:1787359986.755772:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:2362:x1874182508953856:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787359986.755783:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787359986.755800:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce60b expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.755813:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:2.0:1787359986.755816:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359986.755846:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:2362:x1874182508953856:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 75us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.755852:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:1.0:1787359986.763381:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.763440:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.763518:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508954112 00000100:00100000:3.0:1787359986.763530:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508954112 00000100:00100000:3.0:1787359986.763597:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:3.0:1787359986.763608:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2365:x1874182508954112:12345-192.168.201.14@tcp:16:kworker.0 00000100:00100000:3.0:1787359986.763749:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2365:x1874182508954112:12345-192.168.201.14@tcp:16:kworker.0 Request processed in 142us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.763756:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:1.0:1787359986.766640:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.766834:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508954240 00000100:00100000:0.0:1787359986.766845:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508954240 00000100:00100000:0.0:1787359986.766908:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:0.0:1787359986.766920:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508954240:12345-192.168.201.14@tcp:1:lfs.0 00010000:00010000:0.0:1787359986.766988:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.767012:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.767022:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787359986.767026:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787359986.767031:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.767070:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.767085:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 8 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.767098:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1874182527846272:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359986.767184:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359986.768829:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508953984 00000100:00100000:2.0:1787359986.768840:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508953984 00002000:00100000:2.0:1787359986.768885:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff983d27f4e680 x1874182508953984/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:177/0 lens 504/0 e 0 to 0 dl 1787359997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1787359986.768902:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6700:1874182527846272:192.168.201.14@tcp:104: 00002000:00100000:2.0:1787359986.768904:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d27f4e680 with x1874182508953984 ext(0->8) 00010000:00010000:2.0:1787359986.768916:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 9 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.768928:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 9 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787359986.768934:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d27f4e680 00010000:00010000:0.0:1787359986.768936:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.768980:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:2.0:1787359986.768991:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2365:x1874182508953984:12345-192.168.201.14@tcp:4:lfs.0 00000100:00100000:2.0:1787359986.769468:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2365:x1874182508953984:12345-192.168.201.14@tcp:4:lfs.0 Request processed in 479us (6026us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787359986.769476:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00002000:00100000:2.0:1787359986.769483:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff983d27f4e680 x1874182508953984/t4294967302(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:177/0 lens 504/448 e 0 to 0 dl 1787359997 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787359986.769489:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d27f4e680 with x1874182508953984 ext(0->8) 00010000:00010000:2.0:1787359986.769494:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.769516:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787359986.769521:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d27f4e680 00000100:00100000:0.0:1787359986.772036:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.772305:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508954368 00000100:00100000:1.0:1787359986.772318:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508954368 00010000:00010000:1.0:1787359986.772365:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.772455:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:1.0:1787359986.772468:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2364:x1874182508954368:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359986.772486:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787359986.772518:0:5848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787359986.772521:0:5848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787359985 00002000:00010000:1.0:1787359986.772524:0:5848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787359986 00002000:00010000:1.0:1787359986.772526:0:5848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787359985 00010000:00010000:1.0:1787359986.772533:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.772549:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.772587:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef3e23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5fd expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.772627:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787359986.772631:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787359986.772638:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.772649:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.772726:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359986.772785:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2364:x1874182508954368:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 319us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.772795:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 50 00010000:00010000:0.0:1787359986.772867:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772885:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772912:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772922:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772931:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772940:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787359986.772945:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772955:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772968:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.772977:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef3e62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.773054:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508954240:12345-192.168.201.14@tcp:1:lfs.0 Request processed in 6136us (6422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359986.773063:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:0.0:1787359986.775082:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359986.775150:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508954624 00000100:00100000:2.0:1787359986.775253:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508954624 00000100:00100000:2.0:1787359986.775312:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:2.0:1787359986.775324:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1056ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:10519:x1874182508954624:12345-192.168.201.14@tcp:35:lfs.0 00000004:00010000:2.0:1787359986.775386:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce612 expref: 38 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787359986.775638:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787359986.775694:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787359986.776534:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787359986.776730:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.776746:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.776753:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.776800:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.776813:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 42 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.776826:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1874182527846400:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359986.776907:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f7f9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359986.780169:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.780169:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1874182527846400:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359986.780205:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.780555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508954752 00000100:00100000:3.0:1787359986.780564:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508954752 00010000:00010000:3.0:1787359986.780607:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 43 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.780652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:3.0:1787359986.780664:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+43:2362:x1874182508954752:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359986.780711:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359986.780721:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 43 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.780735:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 43 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.780879:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef3e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5ef expref: 43 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.780895:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:3.0:1787359986.780900:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.780925:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.780932:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.780962:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359986.781010:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.781018:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.781020:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+42:2362:x1874182508954752:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 357us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.781027:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 51 00000001:00080000:1.0:1787359986.781149:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787359986.781358:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787359986.781482:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1874182527846528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787359986.781544:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359986.781587:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787359986.781919:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527846528 00000100:00100000:3.0:1787359986.781926:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527846528 00000100:00100000:3.0:1787359986.781967:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787359986.781976:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1874182527846528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787359986.782054:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1874182527846528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.782061:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787359986.782091:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1874182527846528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787359986.782656:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787359986.782738:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1874182527846656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787359986.782775:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359986.782958:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d086fb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787359986.783146:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527846656 00000100:00100000:3.0:1787359986.783151:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527846656 00000100:00100000:3.0:1787359986.783176:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787359986.783181:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1874182527846656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787359986.783299:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5865:x1874182527846656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (524us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787359986.783308:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787359986.783382:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1874182527846656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787359986.783429:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787359986.783558:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.783569:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.783577:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.783584:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359986.783589:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.783597:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.783615:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:1.0:1787359986.783618:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787359986.783624:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.783631:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef3e69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787359986.783931:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787359986.784032:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787359986.784043:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361112365164ns, next at 362112363236ns, rc = 0 00000001:00080000:1.0:1787359986.784050:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787359986.784083:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d25919600) 00010000:00010000:1.0:1787359986.784086:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787359986.784094:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3e54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce612 expref: 46 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.784264:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1056ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+45:10519:x1874182508954624:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 8941us (9188us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787359986.784274:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 26 00000020:00080000:1.0:1787359986.784278:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787359986.786605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.786977:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508954880 00000100:00100000:1.0:1787359986.786989:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508954880 00000100:00100000:1.0:1787359986.787043:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 100 00000100:00100000:1.0:1787359986.787054:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+45:10519:x1874182508954880:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359986.787080:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359986.787104:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce619 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.787160:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce619 expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.787171:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce619 expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.787200:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359986.787203:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787359986.787206:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3e00, rc 0) 00000100:00100000:1.0:1787359986.787253:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+46:10519:x1874182508954880:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 202us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359986.787261:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 100 00000100:00100000:2.0:1787359986.790278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.790492:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508955136 00000100:00100000:3.0:1787359986.790516:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508955136 00000100:00100000:3.0:1787359986.790619:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:3.0:1787359986.790636:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+46:10519:x1874182508955136:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:3.0:1787359986.790928:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10519:x1874182508955136:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 293us (660us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787359986.790938:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:2.0:1787359986.869480:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.869594:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508955264 00000100:00100000:0.0:1787359986.869607:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508955264 00000100:00100000:0.0:1787359986.869671:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 101 00000100:00100000:0.0:1787359986.869702:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10530:x1874182508955264:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:0.0:1787359986.869799:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869818:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869828:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869840:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869845:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869849:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869929:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869948:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.869953:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787359986.869989:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870000:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870006:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870014:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870020:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.870025:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870033:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870046:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359986.870049:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.870054:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870060:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870237:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870243:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870247:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870250:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.870252:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870256:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870261:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750500) 00010000:00010000:0.0:1787359986.870263:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.870265:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870268:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870279:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870283:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870287:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870294:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.870296:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870300:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870304:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359986.870305:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.870306:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.870309:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.870374:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10530:x1874182508955264:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 673us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359986.870383:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 101 00000100:00100000:2.0:1787359986.906650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.906719:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508955520 00000100:00100000:0.0:1787359986.906731:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508955520 00000100:00100000:0.0:1787359986.906908:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 102 00000100:00100000:0.0:1787359986.906921:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:10533:x1874182508955520:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359986.906945:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.906970:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce620 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907073:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907109:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907122:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907140:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907147:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907154:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907293:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907302:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907310:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359986.907319:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787359986.907575:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907584:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907591:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907605:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.907610:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907619:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907632:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:0.0:1787359986.907635:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.907640:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907646:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3e93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907659:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907665:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907671:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907724:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.907727:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907733:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907761:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d09750500) 00010000:00010000:0.0:1787359986.907764:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787359986.907767:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907773:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3e9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907817:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3e8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 50 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907831:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 49 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.907839:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359986.907841:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787359986.907844:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787359986.907916:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+49:10533:x1874182508955520:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 997us (1329us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787359986.907925:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 102 00000100:00100000:2.0:1787359986.910363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.910417:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508955648 00000100:00100000:0.0:1787359986.910429:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508955648 00000100:00100000:0.0:1787359986.910721:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 103 00000100:00100000:0.0:1787359986.910733:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+49:10533:x1874182508955648:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:0.0:1787359986.910805:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910822:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910847:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910873:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910879:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910886:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910891:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359986.910895:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910902:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910914:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359986.910916:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787359986.910921:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.910927:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.911001:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+49:10533:x1874182508955648:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 270us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359986.911010:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 103 00000100:00100000:2.0:1787359986.913768:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.913855:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508955904 00000100:00100000:1.0:1787359986.913868:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508955904 00000100:00100000:1.0:1787359986.913932:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 28 00000100:00100000:1.0:1787359986.913944:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+49:10533:x1874182508955904:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787359986.914187:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10533:x1874182508955904:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 244us (435us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787359986.914195:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 28 00000100:00100000:2.0:1787359986.967978:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.968060:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508956160 00000100:00100000:1.0:1787359986.968071:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508956160 00000100:00100000:1.0:1787359986.968126:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 104 00000100:00100000:1.0:1787359986.968138:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10543:x1874182508956160:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:1.0:1787359986.968164:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359986.968168:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787359986.968198:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce604 expref: 50 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.968214:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359986.968218:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359986.968230:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3eb6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce627 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.968348:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.968359:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 50 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.968371:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.968403:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 50 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359986.968414:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 50 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359986.968424:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527846784:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359986.968644:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d13608cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359986.972090:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527846784:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359986.972124:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.972888:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.973016:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508956288 00000100:00100000:0.0:1787359986.973035:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508956288 00010000:00010000:0.0:1787359986.973077:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 51 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.973158:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00100000:0.0:1787359986.973169:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:2362:x1874182508956288:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359986.973188:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359986.973196:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 51 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.973210:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 51 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.973234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce620 expref: 51 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.973250:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359986.973255:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.973265:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.973273:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.973306:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359986.973375:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:2362:x1874182508956288:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 206us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359986.973393:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 52 00010000:00010000:2.0:1787359986.973458:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.973466:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359986.973487:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787359986.974961:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef3eb6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.974987:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.974997:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787359986.974999:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787359986.975003:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2e00, rc 0) 00000100:00100000:2.0:1787359986.975052:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10543:x1874182508956160:12345-192.168.201.14@tcp:101:bash.0 Request processed in 6916us (7082us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787359986.975061:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 104 00000100:00100000:2.0:1787359986.979923:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359986.979987:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508956544 00000100:00100000:3.0:1787359986.979999:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508956544 00000100:00100000:3.0:1787359986.980055:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 105 00000100:00100000:3.0:1787359986.980063:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:10543:x1874182508956544:12345-192.168.201.14@tcp:36:bash.0 00010000:00010000:3.0:1787359986.980296:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.980322:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.980335:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787359986.980392:0:10018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1787359986.980409:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000477cb99c reply state 00000000d301f3ab transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.980416:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787359986.980508:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10543:x1874182508956544:12345-192.168.201.14@tcp:36:bash.0 Request processed in 444us (591us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787359986.980516:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 105 00000020:00080000:3.0:1787359986.980521:0:10018:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787359986.983743:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.983763:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.983789:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.983796:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787359986.983801:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.983809:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.983827:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787359986.983831:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787359986.983836:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.983842:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3ecb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359986.984795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.985409:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508956672 00000100:00100000:0.0:1787359986.985423:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508956672 00000100:00100000:0.0:1787359986.985481:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 106 00000100:00100000:0.0:1787359986.985506:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10543:x1874182508956672:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787359986.985533:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359986.985554:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce62e expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.985640:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.985657:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.985665:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.985867:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359986.985884:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 53 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359986.985899:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527846912:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359986.986037:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787359986.988848:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359986.988848:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527846912:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359986.988889:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.989202:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508956800 00000100:00100000:3.0:1787359986.989210:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508956800 00010000:00010000:3.0:1787359986.989253:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 54 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359986.989344:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:3.0:1787359986.989356:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:2362:x1874182508956800:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359986.989378:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359986.989385:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 54 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.989398:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 54 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.989423:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef3ebd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce627 expref: 54 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.989442:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359986.989448:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.989457:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.989466:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359986.989506:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359986.989578:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:2362:x1874182508956800:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 223us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359986.989587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 53 00010000:00010000:2.0:1787359986.989872:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.989880:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359986.989929:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787359986.989935:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787359986.989957:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.990002:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 53 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.990020:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 52 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359986.990029:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787359986.990032:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359986.990035:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:2.0:1787359986.990084:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10543:x1874182508956672:12345-192.168.201.14@tcp:101:bash.0 Request processed in 4593us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359986.990091:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 106 00000100:00100000:2.0:1787359986.993365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359986.993476:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508957056 00000100:00100000:1.0:1787359986.993489:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508957056 00000100:00100000:1.0:1787359986.993923:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:1.0:1787359986.993937:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:10543:x1874182508957056:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:1.0:1787359986.994191:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10543:x1874182508957056:12345-192.168.201.14@tcp:35:bash.0 Request processed in 257us (835us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787359986.994213:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:1.0:1787359987.044379:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.044545:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508957184 00000100:00100000:3.0:1787359987.044583:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508957184 00000100:00100000:3.0:1787359987.044657:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 107 00000100:00100000:3.0:1787359987.044670:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+53:10549:x1874182508957184:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359987.044728:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359987.045044:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3ee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce635 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.045119:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.045135:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.045148:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359987.045213:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787359987.045218:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359987.045244:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.045272:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3ee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce635 expref: 55 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.045292:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce635 expref: 54 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.045301:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:3.0:1787359987.045305:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787359987.045309:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62200, rc 0) 00000100:00100000:3.0:1787359987.045448:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10549:x1874182508957184:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 780us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.045457:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 107 00000100:00100000:2.0:1787359987.050178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.050278:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508957312 00000100:00100000:1.0:1787359987.050297:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508957312 00000100:00100000:1.0:1787359987.050623:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 108 00000100:00100000:1.0:1787359987.050636:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10549:x1874182508957312:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359987.050659:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359987.050719:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3eee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce63c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.050791:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.050809:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.050821:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.050838:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.050845:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.050851:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051060:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051082:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051089:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359987.051128:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787359987.051133:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359987.051151:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051162:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051172:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051178:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051184:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051190:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.051195:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051203:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051215:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359987.051219:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.051232:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051238:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051254:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051261:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051267:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051272:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.051275:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051295:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051302:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d20336d00) 00010000:00010000:1.0:1787359987.051305:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.051307:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051313:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3efc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051348:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3eee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051376:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.051383:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.051386:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787359987.051388:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3600, rc 0) 00000100:00100000:1.0:1787359987.051513:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10549:x1874182508957312:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 879us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.051522:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 108 00000100:00100000:2.0:1787359987.057096:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.057180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.059925:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508957568 00000100:00100000:0.0:1787359987.059943:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508957568 00000100:00100000:0.0:1787359987.060027:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 109 00000100:00100000:0.0:1787359987.060038:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10549:x1874182508957568:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787359987.060062:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787359987.060086:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce643 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060203:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060221:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060230:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060240:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060296:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060311:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 56 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.060472:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527847040:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359987.060814:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.060824:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.060834:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527847168:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359987.060859:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787359987.061137:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508957696 00000100:00100000:1.0:1787359987.061144:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508957696 00010000:00010000:1.0:1787359987.061173:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 57 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.061208:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:1.0:1787359987.061217:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:2362:x1874182508957696:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359987.061228:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359987.061235:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 57 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.061247:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 57 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.061266:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.061271:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.061650:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.061656:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359987.061727:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:2362:x1874182508957696:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 510us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.061735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:2.0:1787359987.063979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:0.0:1787359987.064006:0:5861:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.14@tcp) returned -22 from blocking AST (req@0000000050ea351c x1874182527847040) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 56 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.064028:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef3f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce63c expref: 56 pid: 5862 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.064046:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527847040:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359987.064061:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527847168:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359987.064084:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359987.064090:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.064098:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.064125:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.064184:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508957824 00000100:00100000:1.0:1787359987.064193:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508957824 00010000:00010000:1.0:1787359987.064231:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.064272:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 55 00000100:00100000:1.0:1787359987.064292:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:2363:x1874182508957824:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359987.064308:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359987.064417:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.064430:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.064451:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce62e expref: 56 pid: 5863 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.064462:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.064466:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.064480:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.064488:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.064527:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359987.064591:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:2363:x1874182508957824:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 310us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.064599:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 55 00010000:00010000:0.0:1787359987.064797:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.064804:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787359987.064822:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787359987.064968:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef3f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.064983:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.064991:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359987.064994:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787359987.064997:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41800, rc 0) 00000100:00100000:0.0:1787359987.065037:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10549:x1874182508957568:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 5001us (7950us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787359987.065045:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 109 00000100:00100000:2.0:1787359987.067441:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.067535:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958080 00000100:00100000:0.0:1787359987.067546:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958080 00000100:00100000:0.0:1787359987.067633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787359987.067645:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10549:x1874182508958080:12345-192.168.201.14@tcp:103:lfs.0 00010000:00010000:0.0:1787359987.067662:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359987.067732:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef3e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce619 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.067755:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359987.067761:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359987.067818:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10549:x1874182508958080:12345-192.168.201.14@tcp:103:lfs.0 Request processed in 175us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.067826:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:3.0:1787359987.070464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.071837:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958208 00000100:00100000:2.0:1787359987.071854:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958208 00000100:00100000:2.0:1787359987.071928:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 110 00000100:00100000:2.0:1787359987.071941:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10549:x1874182508958208:12345-192.168.201.14@tcp:58:lfs.0 00010000:00010000:2.0:1787359987.072070:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.072089:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.072109:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787359987.072308:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787359987.072422:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10549:x1874182508958208:12345-192.168.201.14@tcp:58:lfs.0 Request processed in 483us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359987.072431:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 110 00000100:00100000:2.0:1787359987.074062:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.074125:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958336 00000100:00100000:3.0:1787359987.074134:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958336 00000100:00100000:3.0:1787359987.074178:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 111 00000100:00100000:3.0:1787359987.074189:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:10549:x1874182508958336:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787359987.074207:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359987.074227:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce64a expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.074274:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.074283:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 55 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.074304:0:10018:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.074326:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 55 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.074343:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359987.074346:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787359987.074350:0:10018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 55 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.074385:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62600, rc 0) 00000100:00100000:3.0:1787359987.074435:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10549:x1874182508958336:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 247us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.074442:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 111 00000001:00080000:1.0:1787359987.188604:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1787359987.188626:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787359987.188637:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000040:00080000:1.0:1787359987.495037:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787359987.495046:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787359987.495084:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787359987.495090:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787359987.495241:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527847296:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787359987.495363:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3a028480 going to sleep for 11 seconds 00000100:00100000:2.0:1787359987.499574:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.499731:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958464 00000100:00100000:3.0:1787359987.499743:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958464 00000100:00100000:3.0:1787359987.499813:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 112 00000100:00100000:3.0:1787359987.499825:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508958464:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787359987.499862:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787359987.499978:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508958464:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 155us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.499987:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 112 00000100:00100000:1.0:1787359987.500458:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527847296:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787359987.511735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.512128:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958592 00000100:00100000:3.0:1787359987.512143:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958592 00000100:00100000:3.0:1787359987.512220:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 113 00000100:00100000:3.0:1787359987.512234:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10550:x1874182508958592:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.512319:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512339:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512416:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512499:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512522:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512529:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512552:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512560:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.512566:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359987.512608:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787359987.512613:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359987.512627:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513265:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513274:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513281:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513287:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359987.513292:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513308:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513323:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:3.0:1787359987.513327:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359987.513333:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513339:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513847:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513856:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513863:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513868:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359987.513871:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513877:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513885:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff983d0947c900) 00010000:00010000:3.0:1787359987.513888:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359987.513891:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513908:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.513926:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.517274:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.517285:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.517291:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359987.517297:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.517307:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.517328:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359987.517332:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359987.517338:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.517345:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.518585:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10550:x1874182508958592:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 Request processed in 6346us (6863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.518598:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 113 00000100:00100000:0.0:1787359987.522259:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.522502:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958848 00000100:00100000:3.0:1787359987.522515:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958848 00000100:00100000:3.0:1787359987.522585:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 114 00000100:00100000:3.0:1787359987.522597:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:10550:x1874182508958848:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.522621:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359987.522645:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce651 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.522872:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.522889:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.522902:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359987.522914:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787359987.523326:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523336:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523343:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523480:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359987.523494:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523504:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523534:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359987.523537:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787359987.523543:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523550:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523594:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f42 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce651 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523605:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:3.0:1787359987.523608:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787359987.523611:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce651 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.523621:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62000, rc 0) 00000100:00100000:3.0:1787359987.523758:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508958848:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1163us (1508us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787359987.523767:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 114 00000100:00100000:2.0:1787359987.530031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.530178:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508958976 00000100:00100000:1.0:1787359987.530192:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508958976 00000100:00100000:1.0:1787359987.530264:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:1.0:1787359987.530276:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508958976:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787359987.530315:0:10018:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787359987.530440:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508958976:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 166us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.530460:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:0.0:1787359987.535529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.536562:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508959232 00000100:00100000:2.0:1787359987.536590:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508959232 00000100:00100000:2.0:1787359987.536788:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 116 00000100:00100000:2.0:1787359987.536812:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508959232:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787359987.536836:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359987.536840:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787359987.536870:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef3ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce635 expref: 56 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.536891:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:2.0:1787359987.536896:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787359987.536912:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3f57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce658 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787359987.537669:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787359987.538097:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.538126:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.538137:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.538196:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef3f57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce658 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.538214:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce658 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.538222:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d25919d00) 00010000:00010000:2.0:1787359987.538224:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359987.538227:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347800, rc 0) 00000100:00100000:2.0:1787359987.538308:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10550:x1874182508959232:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1499us (2789us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787359987.538318:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 116 00000100:00100000:0.0:1787359987.542227:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.542315:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508959488 00000100:00100000:1.0:1787359987.542327:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508959488 00000100:00100000:1.0:1787359987.542400:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 117 00000100:00100000:1.0:1787359987.542412:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10550:x1874182508959488:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787359987.542470:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359987.542535:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce658 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.542556:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d25919d00) 00010000:00010000:1.0:1787359987.542882:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787359987.542905:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.542918:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.542925:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.542939:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.542946:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.542952:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543039:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543044:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543049:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543053:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.543056:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543061:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543067:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359987.543069:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.543072:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543076:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3f6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543084:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543087:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543090:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543098:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.543100:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543104:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543108:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x756e87a (ffff983d20336d00) 00010000:00010000:1.0:1787359987.543109:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.543110:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.543113:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3f73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x756e87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.543175:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508959488:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 766us (959us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787359987.543181:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 117 00000100:00100000:0.0:1787359987.546298:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.546391:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508959616 00000100:00100000:3.0:1787359987.546405:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508959616 00000100:00100000:3.0:1787359987.546470:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 118 00000100:00100000:3.0:1787359987.546481:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:10550:x1874182508959616:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.546512:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359987.546537:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce65f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.546593:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.546608:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.546619:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.546953:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.547037:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.547049:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359987.547051:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787359987.547055:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63a00, rc 0) 00000100:00100000:3.0:1787359987.547159:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10550:x1874182508959616:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 679us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.547167:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 118 00000100:00100000:0.0:1787359987.552936:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.552977:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508959872 00000100:00100000:3.0:1787359987.552993:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508959872 00000100:00100000:3.0:1787359987.553062:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 119 00000100:00100000:3.0:1787359987.553074:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:10550:x1874182508959872:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.553173:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.553212:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.553225:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787359987.553506:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1787359987.553516:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361881838105ns, next at 362881835822ns, rc = 0 00000004:00010000:3.0:1787359987.553696:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df63122e reply state 000000003772d29b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.553953:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787359987.554064:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:10550:x1874182508959872:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 990us (1142us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787359987.554072:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 119 00010000:00010000:1.0:1787359987.555324:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.555340:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.555348:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.555356:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.555360:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.555790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.556087:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508960000 00000100:00100000:3.0:1787359987.556097:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508960000 00000100:00100000:3.0:1787359987.556159:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 120 00000100:00100000:3.0:1787359987.556169:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:10550:x1874182508960000:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.556193:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359987.556215:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce666 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.556281:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.556296:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.556332:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359987.556335:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787359987.556339:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63400, rc 0) 00000100:00100000:3.0:1787359987.556413:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:10550:x1874182508960000:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 245us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.556421:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 120 00010000:00010000:1.0:1787359987.556619:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.556634:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:1.0:1787359987.556637:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787359987.556641:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.556648:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef3f88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.559453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.559602:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508960128 00000100:00100000:2.0:1787359987.559614:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508960128 00000100:00100000:2.0:1787359987.559671:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 38 00000100:00100000:2.0:1787359987.559715:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508960128:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787359987.560087:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508960128:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 373us (641us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787359987.560095:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 38 00000100:00100000:0.0:1787359987.562438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.565615:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508960384 00000100:00100000:3.0:1787359987.565634:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508960384 00000100:00100000:3.0:1787359987.565739:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:3.0:1787359987.565752:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:10550:x1874182508960384:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787359987.566008:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:10550:x1874182508960384:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 257us (3576us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787359987.566017:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:0.0:1787359987.568284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.568538:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508960640 00000100:00100000:1.0:1787359987.568549:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508960640 00000100:00100000:1.0:1787359987.568614:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 121 00000100:00100000:1.0:1787359987.568624:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:10550:x1874182508960640:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787359987.568762:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:10550:x1874182508960640:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 138us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.568769:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 121 00000100:00100000:0.0:1787359987.575770:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.576212:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508960768 00000100:00100000:3.0:1787359987.576227:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508960768 00000100:00100000:3.0:1787359987.576507:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 122 00000100:00100000:3.0:1787359987.576520:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:10550:x1874182508960768:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.576544:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359987.576567:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce66d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.576658:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.576703:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.576740:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787359987.576787:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787359987.576808:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.576837:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef3f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce66d expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.576857:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce66d expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.576867:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359987.576870:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787359987.576874:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63c00, rc 0) 00000100:00100000:3.0:1787359987.576943:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:10550:x1874182508960768:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 425us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.576951:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 122 00000100:00100000:0.0:1787359987.580912:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.581080:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508960896 00000100:00100000:1.0:1787359987.581092:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508960896 00000100:00100000:1.0:1787359987.581270:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:1.0:1787359987.581282:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508960896:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787359987.581302:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359987.581326:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce674 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787359987.581365:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f2f2, blocks: 0x1 00010000:00010000:1.0:1787359987.581401:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1787359987.581406:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359987.581417:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.581437:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 10 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.581453:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2000, rc 0) 00000100:00100000:1.0:1787359987.581529:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2362:x1874182508960896:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 249us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.581537:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:0.0:1787359987.584543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.584617:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961152 00000100:00100000:3.0:1787359987.584628:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961152 00000100:00100000:3.0:1787359987.584724:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 123 00000100:00100000:3.0:1787359987.584736:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:10550:x1874182508961152:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787359987.584847:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:10550:x1874182508961152:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.584856:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 123 00000100:00100000:0.0:1787359987.593097:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.593529:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961280 00000100:00100000:1.0:1787359987.593542:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961280 00000100:00100000:1.0:1787359987.593608:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:1.0:1787359987.593619:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:10550:x1874182508961280:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787359987.593641:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359987.593664:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce67b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.593786:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.593798:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359987.593802:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787359987.593810:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.593867:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 11 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.593882:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 11 pid: 6700 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.593910:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1874182527847424:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359987.594021:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3a0286c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359987.596031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.596290:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961408 00000100:00100000:3.0:1787359987.596308:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961408 00010000:00010000:3.0:1787359987.596365:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 12 pid: 6700 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.596410:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:3.0:1787359987.596420:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:2363:x1874182508961408:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359987.596437:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359987.596463:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 12 pid: 6700 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.596479:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 12 pid: 6700 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.596519:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359987.596523:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359987.596532:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.596543:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.596581:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.596596:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1874182527847552:192.168.201.14@tcp:105: 00000100:00100000:3.0:1787359987.596700:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08240 going to sleep for 11 seconds 00010000:00010000:1.0:1787359987.597209:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fa4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce674 expref: 12 pid: 6700 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.597229:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1874182527847424:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359987.597256:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.597268:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2600, rc 0) 00000100:00100000:1.0:1787359987.597318:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:10550:x1874182508961280:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 3699us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.597326:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:0.0:1787359987.606225:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.606302:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961536 00000100:00100000:2.0:1787359987.606325:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961536 00002000:00100000:2.0:1787359987.606396:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff983d409bbb80 x1874182508961536/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:178/0 lens 504/0 e 0 to 0 dl 1787359998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787359987.606407:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d409bbb80 with x1874182508961536 ext(0->12) 00002000:00010000:2.0:1787359987.606414:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d409bbb80 00000100:00100000:2.0:1787359987.606457:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:2.0:1787359987.606468:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182508961536:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787359987.607273:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5846:1874182527847552:192.168.201.14@tcp:105: 00010000:00010000:3.0:1787359987.607292:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787359987.607323:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:2363:x1874182508961536:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 Request processed in 858us (1107us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787359987.607415:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00002000:00100000:2.0:1787359987.607422:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff983d409bbb80 x1874182508961536/t4294967308(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:178/0 lens 504/448 e 0 to 0 dl 1787359998 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787359987.607429:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d409bbb80 with x1874182508961536 ext(0->12) 00002000:00010000:2.0:1787359987.607432:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d409bbb80 00000100:00100000:3.0:1787359987.609178:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:2363:x1874182508961408:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 12752us (13149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.609192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:0.0:1787359987.612769:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.612929:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961664 00000100:00100000:2.0:1787359987.612941:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961664 00000100:00100000:2.0:1787359987.613096:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 124 00000100:00100000:2.0:1787359987.613109:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:10550:x1874182508961664:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787359987.646797:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:3.0:1787359987.646816:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1787359987.646842:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787359987.646858:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d086fb0c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787359987.646863:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1df8ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d07f22840 00000020:00080000:3.0:1787359987.646866:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1df8a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d110b7800 00000001:00080000:3.0:1787359987.646880:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000020:00080000:3.0:1787359987.646908:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1787359987.646913:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787359987.646918:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787359987.646935:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d32f3c9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787359987.646938:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d3f11c800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d32f3c480 00000020:00080000:3.0:1787359987.646941:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d3f11c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d3a217000 00000020:00080000:3.0:1787359987.647117:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787359987.647281:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787359987.647302:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527847680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787359987.647385:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359987.647424:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787359987.647430:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527847808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787359987.647451:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359987.647479:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527847936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787359987.647526:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359987.647562:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527847680 00000100:00100000:3.0:1787359987.647570:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527847680 00000100:00100000:3.0:1787359987.647616:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527847808 00000100:00100000:3.0:1787359987.647620:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527847808 00000100:00100000:3.0:1787359987.647629:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527847936 00000100:00100000:3.0:1787359987.647631:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527847936 00000100:00100000:3.0:1787359987.647649:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787359987.647658:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527847680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787359987.647707:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1787359987.647737:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.647762:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.647772:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787359987.647777:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787359987.647783:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.647814:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.647830:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 11 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.647841:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1874182527848064:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787359987.647907:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08e40 going to sleep for 11 seconds 00000100:00080000:3.0:1787359987.647926:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787359987.647931:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359987.650933:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10550:x1874182508961664:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 Request processed in 37814us (38162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359987.650947:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 124 00000100:00100000:3.0:1787359987.651077:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e03d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6700:1874182527848064:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787359987.651105:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.651144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.651205:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961792 00000100:00100000:3.0:1787359987.651213:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961792 00010000:00010000:3.0:1787359987.651247:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.652308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 57 00000100:00100000:3.0:1787359987.652322:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:2363:x1874182508961792:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359987.652340:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359987.652348:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.652364:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.652389:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d994f324/0x72f6de40e4ef3d74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5da expref: 12 pid: 6698 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.652407:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787359987.652412:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787359987.652432:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.652443:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.653357:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359987.653378:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.653389:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.653400:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.653408:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359987.653417:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182508961792:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 1097us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359987.653426:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 57 00010000:00010000:3.0:1787359987.653460:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787359987.654057:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3317:x1874182527847680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6398us (6671us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787359987.654066:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787359987.654084:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359987.654093:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527847808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787359987.654197:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787359987.654201:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787359986 00002000:00010000:3.0:1787359987.654203:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787359987.654213:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787359986 -> 1787359986 00002000:00010000:3.0:1787359987.654215:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787359987.654243:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3317:x1874182527847808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (6791us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787359987.654250:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787359987.654262:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787359987.654269:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527847936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787359987.654285:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787359987.654311:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a88f2f1, atime: 0x6a88f2f2, ctime: 0x6a88f2f1, blocks: 0xb 00010000:00010000:3.0:1787359987.654317:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.654330:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1787359987.654333:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359987.654338:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.654349:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.654357:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.654363:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787359987.654452:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f98fb80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787359987.654459:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527847808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787359987.654490:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f98d500/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787359987.654495:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527847680:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787359987.655276:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787359987.655286:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655311:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359987.655317:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655328:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655348:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655357:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dce1d755/0x72f6de40e4ef3fb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655375:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359987.655378:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655385:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359987.655388:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655395:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655406:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.655420:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359987.655422:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359987.655424:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787359987.656604:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787359987.656629:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b6533a/0x72f6de40e4ef3fb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.656886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.657473:0:6701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787359987.657493:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787359987.657933:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508961920 00000100:00100000:3.0:1787359987.657943:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508961920 00000100:00100000:2.0:1787359987.657944:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874182527847936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3673us (10415us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787359987.657953:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787359987.657981:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:2.0:1787359987.657990:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2362:x1874182508961920:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787359987.658054:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787359987.658061:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1787359987.658082:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f194700, transno 4294967301 00000004:00080000:0.0:1787359987.658097:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1787359987.658116:0:3319:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff983d3f98c000 x1874182527847936/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787360003 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787359987.658128:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f98c000/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787359987.658134:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527847936:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787359987.658839:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787359987.705047:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787359987.705062:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787359987.705074:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1787359987.705221:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e03d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508961920:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 Request processed in 47225us (48331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.705237:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:0.0:1787359987.709671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.709863:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508962176 00000100:00100000:3.0:1787359987.709876:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508962176 00000100:00100000:3.0:1787359987.709946:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 125 00000100:00100000:3.0:1787359987.709958:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10550:x1874182508962176:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787359987.710013:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359987.710048:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef3f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce66d expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.710068:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359987.710073:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787359987.710104:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.710119:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.710130:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787359987.710363:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3327605 reply state 00000000aa791f31 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.710393:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787359987.710514:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:10550:x1874182508962176:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 557us (852us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787359987.710522:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 125 00010000:00010000:3.0:1787359987.712608:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.712624:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.712631:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.712638:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359987.712643:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.712651:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.712670:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:3.0:1787359987.712673:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787359987.712710:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.712717:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef3fc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.713317:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.713761:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508962304 00000100:00100000:3.0:1787359987.713774:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508962304 00000100:00100000:3.0:1787359987.713861:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:3.0:1787359987.713873:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508962304:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787359987.714124:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787359987.714128:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787359986 -> 1787359986 00002000:00010000:3.0:1787359987.714130:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787359986 00002000:00010000:3.0:1787359987.714132:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787359986 -> 1787359986 00002000:00010000:3.0:1787359987.714134:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787359987.714255:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508962304:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 383us (943us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787359987.714265:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:2.0:1787359987.716344:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.716476:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508962560 00000100:00100000:3.0:1787359987.716501:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508962560 00000100:00100000:2.0:1787359987.717103:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 126 00000100:00100000:2.0:1787359987.717119:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:10550:x1874182508962560:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787359987.717197:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.717218:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.717228:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.717272:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359987.717287:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 15 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787359987.717303:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527848192:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787359987.717548:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787359987.721713:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.721828:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508962688 00000100:00100000:1.0:1787359987.721841:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508962688 00010000:00010000:1.0:1787359987.721890:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.721927:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 58 00000100:00100000:1.0:1787359987.721937:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:2363:x1874182508962688:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359987.721953:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359987.721960:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.721973:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.721998:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:1.0:1787359987.722003:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.722013:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.722035:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.722056:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787359987.722107:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:2363:x1874182508962688:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.722115:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 58 00010000:00010000:0.0:1787359987.723144:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef3f81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce65f expref: 15 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.723164:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527848192:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359987.723189:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723199:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723206:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723235:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723254:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723262:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723268:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359987.723272:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723281:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723294:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:0.0:1787359987.723297:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787359987.723302:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.723309:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef3fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.723384:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:10550:x1874182508962560:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 Request processed in 6270us (7048us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787359987.723394:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 126 00000100:00100000:0.0:1787359987.726913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.727013:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508962816 00000100:00100000:1.0:1787359987.727023:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508962816 00000100:00100000:1.0:1787359987.727073:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:1.0:1787359987.727081:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508962816:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787359987.727124:0:12078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.727141:0:12078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.727147:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787359987.727150:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787359987.727154:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.727187:0:12078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.727200:0:12078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 7 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.727230:0:12078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12078:1874182527848320:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787359987.727315:0:12078:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df886c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787359987.731665:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.731815:0:12078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12078:1874182527848320:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787359987.731830:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508962944 00000100:00100000:3.0:1787359987.731838:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508962944 00010000:00010000:1.0:1787359987.731848:0:12078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.731879:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 8 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359987.731964:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:3.0:1787359987.731975:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508962944:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787359987.731993:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787359987.732017:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 8 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.732031:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 8 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.732057:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef3fab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce67b expref: 8 pid: 6698 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.732091:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787359987.732095:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787359987.732101:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.732111:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359987.732143:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787359987.732199:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508962944:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 226us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.732208:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 59 00010000:00010000:1.0:1787359987.732261:0:12078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732271:0:12078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732296:0:12078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732304:0:12078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732311:0:12078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732319:0:12078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359987.732324:0:12078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732355:0:12078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732368:0:12078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.732376:0:12078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef3fce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.732423:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508962816:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 Request processed in 5342us (5516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.732430:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:3.0:1787359987.734779:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.734871:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508963200 00000100:00100000:0.0:1787359987.734882:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508963200 00000100:00100000:0.0:1787359987.734944:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 127 00000100:00100000:0.0:1787359987.734955:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:10550:x1874182508963200:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787359987.735050:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735070:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735082:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735288:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735301:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735310:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735361:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.735373:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 15 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.735385:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527848448:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359987.735456:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d33664240 going to sleep for 11 seconds 00000100:00100000:2.0:1787359987.739971:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.740076:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508963328 00000100:00100000:1.0:1787359987.740085:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508963328 00000100:00100000:0.0:1787359987.740098:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527848448:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787359987.740127:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740128:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.740211:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:1.0:1787359987.740222:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:2363:x1874182508963328:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359987.740238:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359987.740246:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740259:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740294:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef3f8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce666 expref: 16 pid: 5862 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740310:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:1.0:1787359987.740316:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740325:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740334:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.740361:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787359987.740426:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.740434:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.740452:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:2363:x1874182508963328:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 231us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.740460:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 60 00000001:00080000:0.0:1787359987.740942:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787359987.741087:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787359987.741130:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787359987.741215:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1874182527848576:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787359987.741516:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359987.741591:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d104016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787359987.741630:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527848576 00000100:00100000:3.0:1787359987.741638:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527848576 00000100:00100000:3.0:1787359987.741830:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787359987.741842:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1874182527848576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787359987.741950:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1874182527848576:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.741958:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787359987.742011:0:5861:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787359987.742018:0:5861:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1787359987.742035:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f98d500, transno 4294967309 00000004:00080000:1.0:1787359987.742052:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f98fb80, transno 4294967310 00000100:00100000:1.0:1787359987.742060:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1874182527848576:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787359987.742548:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787359987.742603:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1874182527848704:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787359987.742637:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787359987.743704:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787359987.743816:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527848704 00000100:00100000:0.0:1787359987.743823:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527848704 00000100:00100000:0.0:1787359987.743862:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787359987.743871:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5861:x1874182527848704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787359987.744075:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5861:x1874182527848704:12345-0@lo:1000:mdt00_000.0 Request processed in 205us (1437us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787359987.744084:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787359987.744143:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1874182527848704:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787359987.744183:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744193:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744200:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744206:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.744211:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744219:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744237:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d0947c900) 00010000:00010000:1.0:1787359987.744241:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787359987.744247:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744254:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef3fdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744286:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744293:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744298:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744313:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.744316:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744321:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744330:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.744332:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787359987.744339:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744350:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744359:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.744389:0:5861:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.744402:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527848832:192.168.201.14@tcp:105: 00000100:00100000:1.0:1787359987.744575:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787359987.749465:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527848832:192.168.201.14@tcp:105: 00010000:00010000:1.0:1787359987.749512:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749542:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef3f1f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749582:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749599:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749612:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749623:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749630:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749636:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749642:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.749646:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749653:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749665:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.749668:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.749671:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749735:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3fe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749854:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749860:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749866:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749871:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.749874:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749879:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749888:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.749890:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787359987.749893:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.749899:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef3fd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.750118:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10550:x1874182508963200:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 15162us (15344us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787359987.750128:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 127 00000020:00080000:1.0:1787359987.750141:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787359987.750303:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359987.750308:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787359987.751056:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787359987.751065:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787359987.751237:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359987.751986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.752038:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508963456 00000100:00100000:0.0:1787359987.752048:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508963456 00000100:00100000:0.0:1787359987.752092:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:0.0:1787359987.752099:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10549:x1874182508963456:12345-192.168.201.14@tcp:49:lfs.0 00000100:00100000:0.0:1787359987.752192:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10549:x1874182508963456:12345-192.168.201.14@tcp:49:lfs.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.752199:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:2.0:1787359987.754219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359987.754272:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508963712 00000100:00100000:3.0:1787359987.754283:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508963712 00000100:00100000:3.0:1787359987.754338:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 128 00000100:00100000:3.0:1787359987.754359:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10549:x1874182508963712:12345-192.168.201.14@tcp:58:lfs.0 00000040:00080000:3.0:1787359987.754933:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787359987.755018:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10549:x1874182508963712:12345-192.168.201.14@tcp:58:lfs.0 Request processed in 670us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.755026:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 128 00000100:00100000:2.0:1787359987.761304:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.761444:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508963968 00000100:00100000:0.0:1787359987.761458:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508963968 00000100:00100000:0.0:1787359987.761531:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:0.0:1787359987.761542:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10568850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:10550:x1874182508963968:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787359987.762245:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787359987.762910:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787359987.762969:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.762988:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.763001:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.763012:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.763019:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.763027:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.763089:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787359987.763195:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10568850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:10550:x1874182508963968:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 1652us (1899us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787359987.763207:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 32 00000020:00080000:0.0:1787359987.763213:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787359987.764155:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787359987.764165:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.764175:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787359987.764180:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.764189:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.764205:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff983d09750200) 00010000:00010000:1.0:1787359987.764208:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787359987.764213:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.764219:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef3fea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.764240:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359987.764242:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359987.764244:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787359987.787563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.787784:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964096 00000100:00100000:1.0:1787359987.787799:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964096 00000100:00100000:1.0:1787359987.787868:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 129 00000100:00100000:1.0:1787359987.787880:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:10552:x1874182508964096:12345-192.168.201.14@tcp:101:lfs.0 00000100:00100000:2.0:1787359987.788947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.788987:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359987.789018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.789101:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964224 00000100:00100000:1.0:1787359987.789110:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964224 00000100:00100000:1.0:1787359987.789156:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 287 00000100:00100000:1.0:1787359987.789168:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508964224:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359987.789264:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182508964224:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 98us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.789273:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 287 00010000:00010000:1.0:1787359987.789336:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359987.789879:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce682 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.789949:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.789966:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.789978:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.789994:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.790001:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.790008:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.790478:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.790501:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.790522:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.790760:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964480 00000100:00100000:0.0:1787359987.790767:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964480 00000100:00080000:2.0:1787359987.790836:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359987.790841:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 133 00000100:00100000:0.0:1787359987.790850:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508964480:12345-192.168.201.14@tcp:400:kworker.0 00010000:00010000:1.0:1787359987.790871:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.790887:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 21 pid: 5861 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787359987.790902:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527848960:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787359987.790908:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2363:x1874182508964480:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 61us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.790916:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 133 00000100:00100000:1.0:1787359987.790962:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88000 going to sleep for 11 seconds 00000100:00100000:3.0:1787359987.791557:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964352 00000100:00100000:3.0:1787359987.791563:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964352 00000100:00100000:3.0:1787359987.791619:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:3.0:1787359987.791628:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508964352:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359987.791665:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508964352:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 38us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359987.791672:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:2.0:1787359987.796053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359987.796171:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527848960:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787359987.796213:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.796672:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964736 00000100:00100000:0.0:1787359987.796767:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964736 00000100:00100000:0.0:1787359987.796823:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:0.0:1787359987.796835:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:5600:x1874182508964736:12345-192.168.201.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787359987.797086:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:5600:x1874182508964736:12345-192.168.201.14@tcp:35:ldlm_bl.0 Request processed in 251us (1041us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787359987.797093:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:1.0:1787359987.798948:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359987.799659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964864 00000100:00100000:0.0:1787359987.799670:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964864 00010000:00010000:0.0:1787359987.799855:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 23 pid: 5861 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787359987.799946:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 61 00000100:00100000:0.0:1787359987.799958:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:2363:x1874182508964864:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787359987.799991:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787359987.800000:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 23 pid: 5861 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.800016:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 23 pid: 5861 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.800058:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef3f11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce643 expref: 23 pid: 5861 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.800074:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359987.800080:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.800090:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.800098:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359987.800133:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359987.800190:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:2363:x1874182508964864:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 233us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359987.800198:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 61 00010000:00010000:1.0:1787359987.800302:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800310:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359987.800365:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787359987.800370:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787359987.800389:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800402:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800419:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800427:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800435:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800441:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.800446:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800454:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800464:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:1.0:1787359987.800467:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.800471:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800488:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef3ff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800502:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800509:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800515:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800525:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787359987.800529:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800535:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800543:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff983d20336d00) 00010000:00010000:1.0:1787359987.800546:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787359987.800549:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800556:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef3fff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800603:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef3ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce682 expref: 22 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800619:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce682 expref: 21 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359987.800626:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359987.800628:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787359987.800631:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3e00, rc 0) 00000100:00100000:1.0:1787359987.800666:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10552:x1874182508964096:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 12787us (13111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359987.800674:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 129 00000100:00100000:3.0:1787359988.135182:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527849088:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135259:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.135323:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527849600:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135361:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.135386:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787359988.135392:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527849472:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135417:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.135446:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527849344:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135472:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787359988.135519:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849088 00000100:00100000:3.0:1787359988.135528:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849088 00000100:00100000:3.0:1787359988.135581:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787359988.135592:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527849088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135650:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527849088:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.135666:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787359988.135724:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849472 00000100:00100000:3.0:1787359988.135728:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849472 00000100:00100000:3.0:1787359988.135765:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787359988.135772:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874182527849472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135802:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874182527849472:12345-0@lo:400:kworker.0 Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.135808:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787359988.135825:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849600 00000100:00100000:3.0:1787359988.135828:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849600 00000100:00100000:3.0:1787359988.135858:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849344 00000100:00100000:3.0:1787359988.135861:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849344 00000100:00100000:3.0:1787359988.135881:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787359988.135887:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527849600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135917:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527849600:12345-0@lo:400:kworker.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.135923:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787359988.135936:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787359988.135942:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527849344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.135985:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527849344:12345-0@lo:400:kworker.0 Request processed in 43us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.135990:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1787359988.136014:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359988.136051:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527849344:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.136095:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527849472:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.136103:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527849088:0@lo:400:kworker.0 00000100:00100000:3.0:1787359988.136121:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527849600:0@lo:400:kworker.0 00000100:00100000:2.0:1787359988.136822:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527849216:0@lo:400:kworker.0 00000100:00100000:2.0:1787359988.136858:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359988.138758:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849216 00000100:00100000:2.0:1787359988.138771:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849216 00000100:00100000:2.0:1787359988.138830:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787359988.138840:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527849216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359988.138922:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527849216:12345-0@lo:400:kworker.0 Request processed in 83us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359988.138930:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787359988.139149:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527849216:0@lo:400:kworker.0 00000040:00080000:2.0:1787359988.515085:0:12116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359988.515093:0:12116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787359988.515135:0:12116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787359988.515140:0:12116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787359988.650047:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527849728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359988.650126:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359988.651219:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849728 00000100:00100000:0.0:1787359988.651231:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849728 00000100:00100000:0.0:1787359988.651323:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787359988.651345:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527849728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787359988.651372:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787359988.651444:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527849728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359988.651452:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787359988.651532:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527849728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787359988.774860:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787359988.775111:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359988.775122:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787359988.775173:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787359988.775180:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787359988.776652:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527849856:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787359988.776851:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787359988.789801:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359988.789921:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527849856:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787359988.790119:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508964992 00000100:00100000:3.0:1787359988.790127:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508964992 00000100:00100000:3.0:1787359988.790201:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 130 00000100:00100000:3.0:1787359988.790213:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10564:x1874182508964992:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787359988.790259:0:10018:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1787359988.790436:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359988.790718:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10564:x1874182508964992:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 504us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359988.790729:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 130 00000100:00100000:3.0:1787359988.793558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359988.794302:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508965248 00000100:00100000:2.0:1787359988.794316:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508965248 00000100:00100000:2.0:1787359988.794404:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 131 00000100:00100000:2.0:1787359988.794421:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:10564:x1874182508965248:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787359988.794442:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359988.794469:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef400d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce689 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.794589:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.794607:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.794619:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359988.794630:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787359988.794795:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef400d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce689 expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.794819:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce689 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359988.794846:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787359988.794850:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787359988.794854:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347c00, rc 0) 00000100:00100000:2.0:1787359988.794936:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:10564:x1874182508965248:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 521us (1386us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787359988.794944:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 131 00000100:00100000:2.0:1787359988.800277:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359988.802449:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359988.802883:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508965632 00000100:00100000:0.0:1787359988.802896:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508965632 00000100:00100000:0.0:1787359988.802979:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 132 00000100:00100000:0.0:1787359988.802991:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:10564:x1874182508965632:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787359988.803088:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803110:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803124:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803358:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803367:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803375:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803381:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787359988.803387:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803396:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803411:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:0.0:1787359988.803415:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787359988.803420:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787359988.803439:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4022 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787359988.804010:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359988.804016:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787359988.804525:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787359988.804536:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787359988.806423:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508965376 00000100:00100000:1.0:1787359988.806442:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508965376 00000100:00100000:1.0:1787359988.806965:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787359988.806985:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:2364:x1874182508965376:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787359988.807004:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787359988.807038:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce689 expref: 25 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359988.807062:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359988.807068:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787359988.807535:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:10564:x1874182508965632:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 4543us (5091us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787359988.807547:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 132 00000100:00100000:2.0:1787359988.811535:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359988.811856:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508965888 00000100:00100000:3.0:1787359988.811873:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508965888 00000100:00100000:3.0:1787359988.811960:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:3.0:1787359988.811974:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:10564:x1874182508965888:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787359988.812259:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:10564:x1874182508965888:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 287us (734us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787359988.812267:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:1.0:1787359988.815329:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:2364:x1874182508965376:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 8337us (15048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359988.815346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00010000:00010000:0.0:1787359989.798969:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787359990.404152:0:12167:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787359990.404162:0:12167:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787359990.404237:0:12167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787359990.404244:0:12167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787359990.599732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359990.602672:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966144 00000100:00100000:1.0:1787359990.602707:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966144 00000100:00100000:1.0:1787359990.602798:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 133 00000100:00100000:1.0:1787359990.602811:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:10584:x1874182508966144:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787359990.602839:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787359990.602866:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce690 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359990.602989:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef4030 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359990.603014:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef4030 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359990.603026:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef4030 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787359990.603040:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787359990.603171:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce690 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359990.603190:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef4030 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce690 expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787359990.603200:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:1.0:1787359990.603203:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787359990.603207:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3200, rc 0) 00000100:00100000:1.0:1787359990.603274:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:10584:x1874182508966144:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 465us (3553us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787359990.603282:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 133 00000100:00080000:1.0:1787359990.603322:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787359990.607278:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359990.607385:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966272 00000100:00100000:3.0:1787359990.607396:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966272 00000100:00100000:3.0:1787359990.607482:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 134 00000100:00100000:3.0:1787359990.607494:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:10584:x1874182508966272:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:3.0:1787359990.607566:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607584:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607597:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607624:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607632:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607639:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607646:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787359990.607651:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607659:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607672:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:3.0:1787359990.607697:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787359990.607703:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.607720:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef403e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787359990.607796:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:10584:x1874182508966272:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 304us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359990.607805:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 134 00000100:00100000:3.0:1787359990.695831:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527849984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787359990.695907:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359990.696315:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527849984 00000100:00100000:0.0:1787359990.696326:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527849984 00000100:00100000:0.0:1787359990.696506:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787359990.696519:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527849984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359990.696561:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359990.696623:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527849984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359990.696632:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787359990.699499:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527849984:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787359990.700200:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787359990.717797:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359990.717889:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966400 00000100:00100000:3.0:1787359990.717902:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966400 00000100:00100000:3.0:1787359990.717981:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:3.0:1787359990.717993:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508966400:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:3.0:1787359990.718014:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787359990.718048:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093efa61/0x72f6de40e4ef4045 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce697 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787359990.718079:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a88f2f2, atime: 0x6a88f2f2, ctime: 0x6a88f2f2, blocks: 0xb 00010000:00010000:3.0:1787359990.718102:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1787359990.718107:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787359990.718119:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093efa61/0x72f6de40e4ef4045 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce697 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.718141:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000093efa61/0x72f6de40e4ef4045 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce697 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787359990.718177:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63c00, rc 0) 00000100:00100000:3.0:1787359990.718316:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508966400:12345-192.168.201.14@tcp:101:cat.0 Request processed in 324us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359990.718324:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00080000:1.0:1787359990.718512:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787359990.724662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359990.724862:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966528 00000100:00100000:2.0:1787359990.724875:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966528 00002000:00100000:2.0:1787359990.724938:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff983d1e3f7b80 x1874182508966528/t0(0) o3->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:181/0 lens 488/0 e 0 to 0 dl 1787360001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787359990.724950:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d1e3f7b80 with x1874182508966528 ext(0->4095) 00002000:00010000:2.0:1787359990.724958:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d1e3f7b80 00000100:00100000:2.0:1787359990.725047:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:2.0:1787359990.725059:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508966528:12345-192.168.201.14@tcp:3:cat.0 00000100:00100000:2.0:1787359990.726771:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508966528:12345-192.168.201.14@tcp:3:cat.0 Request processed in 236us (641us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787359990.726789:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00002000:00100000:2.0:1787359990.726817:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff983d1e3f7b80 x1874182508966528/t0(0) o3->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:181/0 lens 488/4536 e 0 to 0 dl 1787360001 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787359990.726826:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d1e3f7b80 with x1874182508966528 ext(0->4095) 00002000:00010000:2.0:1787359990.726832:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d1e3f7b80 00010000:00010000:1.0:1787359990.822855:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359991.856775:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787359992.323647:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787359992.785994:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:3.0:1787359992.786026:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787359992.786038:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d1df889c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787359992.786042:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1df8a000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d1df886c0 00000020:00080000:3.0:1787359992.786046:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1df8a800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d3fbe7000 00000020:00080000:3.0:1787359992.786079:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1787359992.786217:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787359992.786459:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787359992.820844:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1787359992.820861:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1787359992.877851:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787359992.912007:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359992.912055:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359992.912080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359992.912102:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359992.912122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359992.912151:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966912 00000100:00100000:3.0:1787359992.912163:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966912 00000100:00100000:3.0:1787359992.912223:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967040 00000100:00100000:3.0:1787359992.912226:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967040 00000100:00100000:3.0:1787359992.912252:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:3.0:1787359992.912277:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508966912:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359992.912347:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508966912:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359992.912379:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:3.0:1787359992.912407:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:3.0:1787359992.912415:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508967040:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359992.912441:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508967040:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359992.912447:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:3.0:1787359992.912467:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967168 00000100:00100000:3.0:1787359992.912470:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967168 00000100:00100000:3.0:1787359992.912496:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966784 00000100:00100000:3.0:1787359992.912499:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966784 00000100:00100000:3.0:1787359992.912521:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 137 00000100:00100000:3.0:1787359992.912527:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2364:x1874182508967168:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359992.912554:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2364:x1874182508967168:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359992.912560:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 137 00000100:00100000:3.0:1787359992.912571:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 138 00000100:00100000:3.0:1787359992.912577:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:2364:x1874182508966784:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359992.912598:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:2364:x1874182508966784:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359992.912604:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 138 00000100:00080000:3.0:1787359992.912627:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787359992.912631:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787359992.912633:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787359992.913275:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508966656 00000100:00100000:0.0:1787359992.913282:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508966656 00000100:00100000:0.0:1787359992.913324:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 289 00000100:00100000:0.0:1787359992.913332:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182508966656:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787359992.913386:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182508966656:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 55us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359992.913403:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 289 00000100:00100000:2.0:1787359993.254915:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527850368:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.254990:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359993.255050:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359993.255057:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527850496:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255083:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359993.255124:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527850240:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255146:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359993.255162:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527850752:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255182:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359993.255204:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787359993.255209:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527850112:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255234:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359993.255265:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527850624:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255286:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787359993.255324:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850368 00000100:00100000:2.0:1787359993.255332:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850368 00000100:00100000:2.0:1787359993.255396:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850240 00000100:00100000:2.0:1787359993.255400:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850240 00000100:00100000:2.0:1787359993.255414:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850624 00000100:00100000:2.0:1787359993.255416:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850624 00000100:00100000:2.0:1787359993.255433:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787359993.255442:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527850368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255507:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527850368:12345-0@lo:400:kworker.0 Request processed in 65us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359993.255516:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787359993.255534:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787359993.255540:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527850240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255568:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527850240:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359993.255574:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787359993.255585:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787359993.255590:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527850624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255614:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527850624:12345-0@lo:400:kworker.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359993.255619:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787359993.255636:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850496 00000100:00100000:2.0:1787359993.255639:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850496 00000100:00100000:2.0:1787359993.255662:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850752 00000100:00100000:2.0:1787359993.255665:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850752 00000100:00100000:2.0:1787359993.255708:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787359993.255716:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527850496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255744:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527850496:12345-0@lo:400:kworker.0 Request processed in 30us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359993.255750:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787359993.255760:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787359993.255766:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527850752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255792:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527850752:12345-0@lo:400:kworker.0 Request processed in 26us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359993.255807:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787359993.255848:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527850624:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255858:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527850240:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255866:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787359993.255871:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787359993.255893:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527850752:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255918:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787359993.255923:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f98c000, transno 4294967304 00000100:00100000:2.0:1787359993.255933:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527850496:0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.255941:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527850368:0@lo:400:kworker.0 00000100:00080000:2.0:1787359993.256264:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787359993.256269:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787359993.256272:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359993.256287:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850112 00000100:00100000:2.0:1787359993.256291:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850112 00000100:00100000:2.0:1787359993.256317:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787359993.256323:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527850112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787359993.256361:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527850112:12345-0@lo:400:kworker.0 Request processed in 38us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359993.256368:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787359993.256415:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527850112:0@lo:400:kworker.0 00000100:00100000:3.0:1787359993.766926:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787359993.766952:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527850880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787359993.767042:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359993.767370:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527850880 00000100:00100000:0.0:1787359993.767391:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527850880 00000100:00100000:0.0:1787359993.767457:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787359993.767467:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527850880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787359993.767512:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787359993.768442:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527850880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359993.769399:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527850880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1929us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359993.769412:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:1.0:1787359993.895082:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359994.919161:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359995.540222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359995.540304:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967296 00000100:00100000:2.0:1787359995.540316:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967296 00000100:00100000:2.0:1787359995.540418:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 135 00000100:00100000:2.0:1787359995.540446:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10229:x1874182508967296:12345-192.168.201.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787359995.540560:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10229:x1874182508967296:12345-192.168.201.14@tcp:60:lhsmtool_posix.0 Request processed in 117us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359995.540569:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 135 00000100:00080000:3.0:1787359995.540788:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787359995.546361:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787359995.546529:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967552 00000100:00100000:1.0:1787359995.546541:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967552 00000100:00100000:1.0:1787359995.546605:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:1.0:1787359995.546617:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:10229:x1874182508967552:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787359995.550518:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:10229:x1874182508967552:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 3891us (4164us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787359995.550532:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:1.0:1787359995.718316:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787359995.718632:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967680 00000100:00100000:2.0:1787359995.718645:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967680 00000100:00080000:3.0:1787359995.718718:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787359995.718760:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 136 00000100:00100000:2.0:1787359995.718771:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+5:11038:x1874182508967680:12345-192.168.201.14@tcp:101:lsof.0 00010000:00010000:2.0:1787359995.718793:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787359995.718817:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef404c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce69e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359995.718889:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359995.718904:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359995.718919:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787359995.719123:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787359995.719127:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787359995.719231:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359995.719260:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef404c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359995.719290:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787359995.719300:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:2.0:1787359995.719303:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787359995.719307:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346200, rc 0) 00000100:00100000:2.0:1787359995.719662:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:11038:x1874182508967680:12345-192.168.201.14@tcp:101:lsof.0 Request processed in 890us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359995.719672:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 136 00000100:00100000:2.0:1787359995.815003:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787359995.815028:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527851008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787359995.815099:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359995.815252:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851008 00000100:00100000:0.0:1787359995.815262:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851008 00000100:00100000:0.0:1787359995.815338:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787359995.815359:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527851008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787359995.815398:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359995.815454:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527851008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359995.815463:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787359995.815527:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527851008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787359995.815736:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787359995.943063:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787359996.966845:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787359997.031253:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787359997.031262:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787359997.031562:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787359997.031902:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787359997.934494:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787359997.934515:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787359997.934713:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787359997.934725:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787359997.990857:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787359998.027505:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359998.027623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359998.027671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359998.027734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787359998.027777:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787359998.027832:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968192 00000100:00100000:3.0:1787359998.027846:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968192 00000100:00100000:3.0:1787359998.027912:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968064 00000100:00100000:3.0:1787359998.027915:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968064 00000100:00100000:3.0:1787359998.027940:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:3.0:1787359998.027950:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508968192:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359998.028029:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2364:x1874182508968192:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 80us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787359998.028037:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:1.0:1787359998.028254:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967808 00000100:00100000:1.0:1787359998.028259:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967808 00000100:00100000:1.0:1787359998.028292:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 291 00000100:00100000:1.0:1787359998.028301:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182508967808:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787359998.028342:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182508967808:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 43us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359998.028349:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 291 00000100:00100000:3.0:1787359998.028600:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:3.0:1787359998.028613:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508968064:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359998.028642:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2364:x1874182508968064:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 32us (907us total) trans 0 rc 0/0 00000100:00080000:1.0:1787359998.031189:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359998.031198:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787359998.031427:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508967936 00000100:00100000:2.0:1787359998.031440:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508967936 00000100:00100000:2.0:1787359998.031507:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968320 00000100:00100000:2.0:1787359998.031510:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968320 00000100:00100000:2.0:1787359998.031538:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 142 00000100:00100000:2.0:1787359998.031548:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:2364:x1874182508967936:12345-192.168.201.14@tcp:400:kworker.0 00000100:00080000:1.0:1787359998.031637:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787359998.031658:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 143 00000100:00100000:1.0:1787359998.031668:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+6:2364:x1874182508968320:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787359998.035137:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:1.0:1787359998.038020:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+6:2364:x1874182508968320:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 6340us (10228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359998.038036:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 143 00000100:00100000:2.0:1787359998.038893:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:2364:x1874182508967936:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 7344us (11398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787359998.038914:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 142 00000100:00100000:0.0:1787359998.378023:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527851264:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378120:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.378196:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527851776:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378226:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.378269:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787359998.378275:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527851136:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378337:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.378355:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527851648:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378375:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.378401:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527851392:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378421:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.378437:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787359998.378441:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527851520:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378458:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.378486:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851776 00000100:00100000:0.0:1787359998.378493:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851776 00000100:00100000:0.0:1787359998.378543:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851520 00000100:00100000:0.0:1787359998.378545:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851520 00000100:00100000:0.0:1787359998.378567:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787359998.378577:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527851776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378646:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527851776:12345-0@lo:400:kworker.0 Request processed in 69us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359998.378653:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787359998.378672:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787359998.378710:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527851520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378744:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527851520:12345-0@lo:400:kworker.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359998.378749:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787359998.378768:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851136 00000100:00100000:0.0:1787359998.378772:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851136 00000100:00100000:0.0:1787359998.378805:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787359998.378811:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527851136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378849:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527851136:12345-0@lo:400:kworker.0 Request processed in 39us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359998.378854:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787359998.378878:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851264 00000100:00100000:0.0:1787359998.378881:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851264 00000100:00100000:0.0:1787359998.378901:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851648 00000100:00100000:0.0:1787359998.378903:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851648 00000100:00100000:0.0:1787359998.378915:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851392 00000100:00100000:0.0:1787359998.378918:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851392 00000100:00100000:0.0:1787359998.378932:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787359998.378938:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527851264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.378966:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527851264:12345-0@lo:400:kworker.0 Request processed in 28us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359998.378973:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1787359998.379093:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787359998.379099:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787359998.379101:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787359998.379125:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787359998.379133:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527851648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379167:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527851648:12345-0@lo:400:kworker.0 Request processed in 37us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359998.379173:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787359998.379185:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787359998.379191:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527851392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379216:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527851392:12345-0@lo:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787359998.379222:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787359998.379270:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527851520:0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379277:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e241500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527851392:0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379297:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527851136:0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379323:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527851648:0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379333:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527851264:0@lo:400:kworker.0 00000100:00100000:1.0:1787359998.379343:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527851776:0@lo:400:kworker.0 00000100:00100000:0.0:1787359998.887221:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527851904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787359998.887327:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787359998.887424:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527851904 00000100:00100000:0.0:1787359998.887442:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527851904 00000100:00100000:0.0:1787359998.887499:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787359998.887510:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527851904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787359998.887556:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787359998.887605:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527851904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787359998.887613:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787359998.887670:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527851904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787359999.022401:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787359999.056386:0:12370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:53:17 (1787359997) 00010000:00010000:1.0:1787360000.038973:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360000.214967:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360000.215303:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968576 00000100:00100000:1.0:1787360000.215326:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968576 00000100:00100000:1.0:1787360000.215497:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 137 00000100:00100000:1.0:1787360000.215512:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+13:11303:x1874182508968576:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360000.215535:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360000.215559:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef405a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6a5 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.215645:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.215661:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.215939:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.215962:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.215971:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.215979:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.216574:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef406f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.216585:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef406f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.216601:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef406f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360000.216612:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787360000.217259:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217277:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217285:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217291:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360000.217296:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217303:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217326:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff983d20336e00) 00010000:00010000:1.0:1787360000.217329:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360000.217334:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217340:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4061 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217356:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217362:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217376:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217381:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360000.217383:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217389:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217398:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff983d20336400) 00010000:00010000:1.0:1787360000.217401:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360000.217403:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.217409:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4068 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.218324:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef405a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6a5 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.218346:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef406f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6a5 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360000.218355:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:1.0:1787360000.218357:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360000.218360:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2e00, rc 0) 00000100:00100000:1.0:1787360000.218452:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:11303:x1874182508968576:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 2943us (3495us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787360000.218764:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 137 00000100:00080000:2.0:1787360000.219222:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360000.225553:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360000.225725:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968704 00000100:00100000:0.0:1787360000.225753:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968704 00000100:00100000:0.0:1787360000.225841:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 138 00000100:00100000:0.0:1787360000.225855:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:11303:x1874182508968704:12345-192.168.201.14@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787360000.226145:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:11303:x1874182508968704:12345-192.168.201.14@tcp:59:lhsmtool_posix.0 Request processed in 292us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360000.226153:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 138 00000100:00100000:2.0:1787360000.241318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360000.245040:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968832 00000100:00100000:0.0:1787360000.245057:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968832 00000100:00100000:0.0:1787360000.245148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:0.0:1787360000.245161:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:2365:x1874182508968832:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360000.245179:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360000.245206:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef406f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6a5 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360000.245231:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:0.0:1787360000.245237:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360000.245313:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:2365:x1874182508968832:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 154us (4006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360000.245321:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:0.0:1787360000.936207:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527852032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360000.936290:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360000.936420:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527852032 00000100:00100000:2.0:1787360000.936429:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527852032 00000100:00100000:2.0:1787360000.936494:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360000.936505:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527852032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360000.936565:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360000.936626:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527852032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360000.936634:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787360000.936908:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360000.936956:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527852032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787360001.063026:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360001.134286:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360001.134295:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360001.134332:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787360001.134338:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787360002.089111:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360002.094907:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.095108:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508968960 00000100:00100000:3.0:1787360002.095121:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508968960 00000100:00100000:3.0:1787360002.095202:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 139 00000100:00100000:3.0:1787360002.095214:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:11345:x1874182508968960:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360002.095248:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360002.095273:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef407d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6ac expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095363:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095380:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095392:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095408:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095415:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095423:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095705:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095715:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095721:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095728:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360002.095732:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095750:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095765:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:3.0:1787360002.095769:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360002.095775:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095782:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095795:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.095801:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787360002.096004:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787360002.096067:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096073:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360002.096076:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096083:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096092:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff983d0947cd00) 00010000:00010000:3.0:1787360002.096095:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360002.096098:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096113:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef408b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096150:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef407d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6ac expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096162:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:3.0:1787360002.096165:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360002.096168:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef407d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6ac expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.096178:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62800, rc 0) 00000100:00100000:3.0:1787360002.096918:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:11345:x1874182508968960:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1701us (2013us total) trans 0 rc 301/301 00000100:00100000:3.0:1787360002.096928:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 139 00000100:00100000:3.0:1787360002.109834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.112440:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508969216 00000100:00100000:0.0:1787360002.112458:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508969216 00000100:00100000:0.0:1787360002.112543:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 140 00000100:00100000:0.0:1787360002.112556:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:11345:x1874182508969216:12345-192.168.201.14@tcp:36:lfs.0 00010000:00010000:0.0:1787360002.112616:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360002.112646:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef39fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4e5 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.112665:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:0.0:1787360002.112671:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360002.112960:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.112975:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 5 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.112984:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.113021:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 5 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.113036:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 5 pid: 5861 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360002.113051:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527852160:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360002.113154:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d104016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360002.116176:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.116213:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508969344 00000100:00100000:3.0:1787360002.116225:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508969344 00010000:00010000:3.0:1787360002.116290:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 6 pid: 5861 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360002.116331:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:3.0:1787360002.116342:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:2362:x1874182508969344:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360002.116358:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360002.116406:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 6 pid: 5861 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.116429:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 6 pid: 5861 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.116454:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:3.0:1787360002.116461:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.116471:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.116479:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.116499:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360002.116547:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:2362:x1874182508969344:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 207us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.116555:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00080000:0.0:1787360002.116711:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787360002.116749:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4053 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce69e expref: 5 pid: 5861 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360002.116776:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527852160:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360002.116800:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.116821:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.116828:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.116853:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.116863:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.116872:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360002.117986:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787360002.118002:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.118010:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.118018:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.118024:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360002.118036:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.118044:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.118058:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750000) 00010000:00010000:0.0:1787360002.118062:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360002.118066:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.118073:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4092 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360002.118092:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e2cac90 reply state 000000006c6834e3 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360002.118100:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360002.118187:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:11345:x1874182508969216:12345-192.168.201.14@tcp:36:lfs.0 Request processed in 5631us (8360us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787360002.118196:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 140 00010000:00010000:1.0:1787360002.124935:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.124952:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.124960:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.124967:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.124973:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.124981:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.125002:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff983d09750e00) 00010000:00010000:1.0:1787360002.125005:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360002.125011:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.125017:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4099 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360002.223122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360002.223205:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508969472 00000100:00100000:2.0:1787360002.223218:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508969472 00000100:00100000:2.0:1787360002.223300:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 141 00000100:00100000:2.0:1787360002.223312:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+14:11353:x1874182508969472:12345-192.168.201.14@tcp:101:lctl.0 00010000:00010000:2.0:1787360002.223340:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360002.223369:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef40a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6b3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.223446:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef40a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.223476:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef40a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.223502:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef40a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360002.223567:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787360002.223572:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360002.223602:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef40a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.223628:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef40a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6b3 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.223649:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef40a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6b3 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.223659:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:2.0:1787360002.223663:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360002.223667:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347a00, rc 0) 00000100:00100000:2.0:1787360002.223781:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:11353:x1874182508969472:12345-192.168.201.14@tcp:101:lctl.0 Request processed in 471us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360002.223789:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 141 00000100:00100000:3.0:1787360002.291500:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.291629:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508969600 00000100:00100000:0.0:1787360002.291642:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508969600 00000100:00100000:0.0:1787360002.291743:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 142 00000100:00100000:0.0:1787360002.291757:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+15:11359:x1874182508969600:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360002.291779:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360002.291803:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef40ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6ba expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.291874:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.291903:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.291916:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.291934:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.291942:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.291948:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292062:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef40c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292072:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef40c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292079:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef40c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360002.292124:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787360002.292129:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360002.292154:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef40c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292168:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292184:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292190:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292197:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360002.292201:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292210:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292222:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:0.0:1787360002.292226:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360002.292230:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292246:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292261:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292266:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292272:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292277:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360002.292285:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292291:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292299:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff983d09750000) 00010000:00010000:0.0:1787360002.292302:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360002.292304:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292311:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef40bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292350:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef40ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6ba expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292364:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef40c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6ba expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.292370:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360002.292373:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787360002.292376:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41200, rc 0) 00000100:00100000:0.0:1787360002.292448:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:11359:x1874182508969600:12345-192.168.201.14@tcp:101:bash.0 Request processed in 694us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360002.292455:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 142 00000100:00100000:0.0:1787360002.296153:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360002.296253:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508969856 00000100:00100000:2.0:1787360002.296265:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508969856 00000100:00100000:2.0:1787360002.296341:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 143 00000100:00100000:2.0:1787360002.296354:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+16:11359:x1874182508969856:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787360002.296379:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360002.296417:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef40ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6c1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.296561:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.296588:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.296599:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.296724:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.296732:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.296739:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360002.297305:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787360002.297480:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297490:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297498:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297535:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297554:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297560:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297581:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360002.297586:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297594:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297608:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360002.297611:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360002.297617:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297623:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef40d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360002.297638:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e476991 reply state 0000000066e6f598 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.297647:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787360002.297721:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef40ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297736:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.297757:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:2.0:1787360002.297760:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360002.297762:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346800, rc 0) 00000100:00100000:2.0:1787360002.297843:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11359:x1874182508969856:12345-192.168.201.14@tcp:101:bash.0 Request processed in 1492us (1697us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787360002.297852:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 143 00000100:00100000:0.0:1787360002.302972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.303065:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508969984 00000100:00100000:1.0:1787360002.303078:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508969984 00000100:00100000:1.0:1787360002.303174:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:1.0:1787360002.303187:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182508969984:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:1.0:1787360002.303221:0:12078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360002.303257:0:12078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6c8 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360002.303288:0:12078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360002.303312:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1787360002.303318:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360002.303339:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 6 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.303361:0:12078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 6 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.303378:0:12078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2c00, rc 0) 00000100:00100000:1.0:1787360002.303445:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508969984:12345-192.168.201.14@tcp:101:bash.0 Request processed in 261us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.303452:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00080000:0.0:1787360002.303910:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787360002.304520:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.304533:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.304539:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.304545:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360002.304549:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.304557:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.304582:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919a00) 00010000:00010000:2.0:1787360002.304585:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360002.304589:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.304596:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef40d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360002.307284:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.307464:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508970112 00000100:00100000:0.0:1787360002.307500:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508970112 00000100:00100000:0.0:1787360002.307562:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:0.0:1787360002.307585:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:11359:x1874182508970112:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360002.307605:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360002.307626:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6cf expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.307662:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 7 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.307672:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360002.307700:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360002.307706:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.307766:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 7 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.307781:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 7 pid: 12078 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360002.307796:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1874182527852288:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360002.307896:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d104016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360002.311003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360002.311072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508970240 00000100:00100000:2.0:1787360002.311084:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508970240 00010000:00010000:2.0:1787360002.311142:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 8 pid: 12078 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.311190:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:2.0:1787360002.311201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508970240:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360002.311218:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360002.311254:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 8 pid: 12078 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.311269:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 8 pid: 12078 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.311296:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360002.311301:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360002.311311:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.311322:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.311379:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.311415:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527852416:192.168.201.14@tcp:105: 00000100:00100000:2.0:1787360002.311861:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0677ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360002.314638:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527852416:192.168.201.14@tcp:105: 00010000:00010000:0.0:1787360002.314669:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360002.314779:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508970240:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 3579us (3785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360002.314791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 63 00010000:00010000:1.0:1787360002.316443:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef40ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c8 expref: 7 pid: 12078 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360002.316467:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6701:1874182527852288:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360002.316643:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.316664:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41a00, rc 0) 00000100:00100000:1.0:1787360002.317010:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:11359:x1874182508970112:12345-192.168.201.14@tcp:101:bash.0 Request processed in 9428us (9736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.317021:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:2.0:1787360002.320725:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.320877:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508970496 00000100:00100000:1.0:1787360002.320890:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508970496 00000100:00100000:1.0:1787360002.320961:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:1.0:1787360002.320974:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11359:x1874182508970496:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:1.0:1787360002.321371:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11359:x1874182508970496:12345-192.168.201.14@tcp:35:bash.0 Request processed in 398us (692us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787360002.321379:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:3.0:1787360002.423422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.423635:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508970752 00000100:00100000:0.0:1787360002.423648:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508970752 00000100:00100000:0.0:1787360002.423770:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 144 00000100:00100000:0.0:1787360002.423782:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11369:x1874182508970752:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360002.423813:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360002.423841:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6d6 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360002.423970:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787360002.424109:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6d6 expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.424126:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:0.0:1787360002.424129:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360002.424135:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef40fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6d6 expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.424150:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40400, rc 0) 00000100:00100000:0.0:1787360002.424238:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11369:x1874182508970752:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 449us (819us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787360002.424246:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 144 00000100:00100000:2.0:1787360002.428398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.428709:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508971008 00000100:00100000:1.0:1787360002.428722:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508971008 00000100:00100000:1.0:1787360002.428786:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:1.0:1787360002.428797:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11369:x1874182508971008:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360002.429087:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:11369:x1874182508971008:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 290us (698us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787360002.429227:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:2.0:1787360002.508802:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.508975:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508971136 00000100:00100000:1.0:1787360002.508987:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508971136 00000100:00100000:1.0:1787360002.509057:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 145 00000100:00100000:1.0:1787360002.509069:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:11375:x1874182508971136:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360002.509104:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360002.509131:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6dd expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.509204:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.509240:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.509253:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360002.509320:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787360002.509323:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360002.509357:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.509385:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6dd expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.509406:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6dd expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.509415:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360002.509417:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360002.509421:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2800, rc 0) 00000100:00100000:1.0:1787360002.509486:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:11375:x1874182508971136:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 419us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.509888:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 145 00000100:00100000:0.0:1787360002.515190:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.515293:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508971392 00000100:00100000:3.0:1787360002.515306:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508971392 00000100:00100000:3.0:1787360002.515384:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 146 00000100:00100000:3.0:1787360002.515396:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:11375:x1874182508971392:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360002.515419:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360002.515442:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6e4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.515584:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef411e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.515600:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef411e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.515612:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef411e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360002.515625:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787360002.515786:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6e4 expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.515805:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef411e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6e4 expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.515814:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:3.0:1787360002.515817:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360002.515821:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62000, rc 0) 00000100:00100000:3.0:1787360002.515888:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11375:x1874182508971392:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 494us (708us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787360002.515896:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 146 00000100:00100000:3.0:1787360002.521225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.521349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.521474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508971776 00000100:00100000:0.0:1787360002.521502:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508971776 00000100:00100000:0.0:1787360002.521580:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:0.0:1787360002.521609:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:2363:x1874182508971776:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360002.521629:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360002.521657:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef411e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6e4 expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.521713:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:0.0:1787360002.521719:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360002.521778:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:2363:x1874182508971776:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 170us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360002.521785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:1.0:1787360002.523313:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508971648 00000100:00100000:1.0:1787360002.523398:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508971648 00000100:00100000:1.0:1787360002.523467:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 147 00000100:00100000:1.0:1787360002.523478:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:11375:x1874182508971648:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360002.523803:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360002.523840:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef412c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6eb expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.523958:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4133 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.523973:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.523985:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4133 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360002.523997:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787360002.524203:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef412c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6eb expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.524223:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4133 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6eb expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.524242:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:1.0:1787360002.524245:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787360002.524249:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3000, rc 0) 00000100:00100000:1.0:1787360002.524444:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11375:x1874182508971648:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 967us (3228us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787360002.524453:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 147 00000100:00100000:3.0:1787360002.530765:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.530922:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508971904 00000100:00100000:1.0:1787360002.530936:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508971904 00000100:00100000:1.0:1787360002.531004:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:1.0:1787360002.531016:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2362:x1874182508971904:12345-192.168.201.14@tcp:1:lfs.0 00010000:00010000:1.0:1787360002.531086:0:12078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.531121:0:12078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.531130:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360002.531134:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360002.531139:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.531182:0:12078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.531197:0:12078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 6 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360002.531212:0:12078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12078:1874182527852544:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360002.531316:0:12078:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e178780 going to sleep for 11 seconds 00000100:00100000:1.0:1787360002.535195:0:12078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12078:1874182527852544:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360002.535222:0:12078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360002.535583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.535663:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508972032 00000100:00100000:0.0:1787360002.535673:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508972032 00002000:00100000:0.0:1787360002.535771:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff983d39cc2a00 x1874182508972032/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:193/0 lens 504/0 e 0 to 0 dl 1787360013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360002.535782:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d39cc2a00 with x1874182508972032 ext(0->12) 00010000:00010000:0.0:1787360002.535790:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 7 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.535806:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 7 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360002.535813:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d39cc2a00 00000100:00100000:0.0:1787360002.535847:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:0.0:1787360002.535859:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508972032:12345-192.168.201.14@tcp:4:lfs.0 00000100:00100000:0.0:1787360002.536472:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508972032:12345-192.168.201.14@tcp:4:lfs.0 Request processed in 612us (886us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787360002.536487:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00002000:00100000:0.0:1787360002.536496:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff983d39cc2a00 x1874182508972032/t4294967305(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:193/0 lens 504/448 e 0 to 0 dl 1787360013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787360002.536504:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d39cc2a00 with x1874182508972032 ext(0->12) 00010000:00010000:0.0:1787360002.536510:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 9 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.536522:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 9 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360002.536529:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d39cc2a00 00000100:00100000:2.0:1787360002.539558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.539747:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508972160 00000100:00100000:3.0:1787360002.539773:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508972160 00010000:00010000:3.0:1787360002.539822:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 9 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360002.539872:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:3.0:1787360002.539884:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508972160:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360002.539901:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787360002.539924:0:8457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787360002.539926:0:8457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787360001 00002000:00010000:3.0:1787360002.539928:0:8457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787360001 00002000:00010000:3.0:1787360002.539930:0:8457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787360001 00010000:00010000:3.0:1787360002.539936:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 9 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.539951:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 9 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.539977:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f1af31e/0x72f6de40e4ef40f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6cf expref: 9 pid: 6701 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.539996:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360002.540001:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360002.540008:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.540019:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.540074:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360002.540258:0:12078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540281:0:12078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540306:0:12078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540315:0:12078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540322:0:12078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540329:0:12078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360002.540335:0:12078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540344:0:12078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540356:0:12078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.540363:0:12078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db14413/0x72f6de40e4ef4141 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360002.540465:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508971904:12345-192.168.201.14@tcp:1:lfs.0 Request processed in 9449us (9709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.540473:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:3.0:1787360002.540629:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508972160:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 748us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.540637:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:1.0:1787360002.543799:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.544058:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508972416 00000100:00100000:3.0:1787360002.544071:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508972416 00000100:00100000:3.0:1787360002.544198:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 38 00000100:00100000:3.0:1787360002.544211:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10569050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11375:x1874182508972416:12345-192.168.201.14@tcp:35:lfs.0 00000004:00010000:3.0:1787360002.544288:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4133 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6eb expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360002.544886:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787360002.544930:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787360002.545535:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787360002.545603:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.545621:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.545631:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.545703:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.545719:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 29 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360002.545744:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d39cc2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1874182527852672:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787360002.545835:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3c840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360002.553917:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d39cc2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1874182527852672:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360002.553955:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.554052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.554130:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508972544 00000100:00100000:0.0:1787360002.554138:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508972544 00010000:00010000:0.0:1787360002.554179:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 30 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360002.554223:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:0.0:1787360002.554243:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+30:2363:x1874182508972544:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360002.554260:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360002.554269:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 30 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.554282:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 30 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.554308:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef40df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6c1 expref: 30 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.554355:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:0.0:1787360002.554361:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.554371:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.554380:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.554600:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360002.554668:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:2363:x1874182508972544:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 425us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360002.554711:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 65 00010000:00010000:1.0:1787360002.556973:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.556990:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360002.557193:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787360002.557900:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787360002.558037:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527852800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787360002.558183:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360002.558295:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d33785000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360002.558409:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527852800 00000100:00100000:3.0:1787360002.558419:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527852800 00000100:00100000:3.0:1787360002.558551:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360002.558562:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1874182527852800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787360002.558673:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1874182527852800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.558706:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360002.558965:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527852800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787360002.559558:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787360002.559919:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8b4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527852928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787360002.559972:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360002.560011:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e178780 going to sleep for 11 seconds 00000100:00100000:3.0:1787360002.560371:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527852928 00000100:00100000:3.0:1787360002.560380:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527852928 00000100:00100000:3.0:1787360002.560439:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360002.560449:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1874182527852928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787360002.560725:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1874182527852928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 276us (751us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787360002.560733:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360002.561276:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8b4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527852928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787360002.561349:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787360002.561412:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.561423:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.561430:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.561436:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360002.561440:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.561461:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.561496:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:2.0:1787360002.561500:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787360002.561505:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.561511:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4148 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360002.562343:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787360002.562501:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787360002.562513:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376890835596ns, next at 377890833216ns, rc = 0 00000001:00080000:2.0:1787360002.562522:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787360002.562565:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:2.0:1787360002.562569:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787360002.562577:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4133 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6eb expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.562763:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10569050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11375:x1874182508972416:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 18554us (18974us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787360002.562773:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 38 00000020:00080000:2.0:1787360002.562779:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787360002.566395:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.566541:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508972672 00000100:00100000:1.0:1787360002.566557:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508972672 00000100:00100000:1.0:1787360002.566630:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 148 00000100:00100000:1.0:1787360002.566643:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11375:x1874182508972672:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360002.566670:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360002.566730:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef414f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6f2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.566818:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef414f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6f2 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.566845:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef414f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6f2 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.566885:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360002.566889:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360002.566894:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2000, rc 0) 00000100:00100000:1.0:1787360002.566962:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11375:x1874182508972672:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 321us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.566969:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 148 00000100:00080000:0.0:1787360002.567464:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360002.572004:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.572151:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508972928 00000100:00100000:0.0:1787360002.572163:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508972928 00000100:00100000:0.0:1787360002.572268:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:0.0:1787360002.572281:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11375:x1874182508972928:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:0.0:1787360002.572531:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11375:x1874182508972928:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 253us (537us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787360002.572539:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:3.0:1787360002.646761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.646857:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508973184 00000100:00100000:0.0:1787360002.646868:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508973184 00000100:00100000:0.0:1787360002.646923:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 149 00000100:00100000:0.0:1787360002.646935:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11385:x1874182508973184:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360002.646961:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360002.646994:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce6f9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360002.647102:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787360002.647197:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4156 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6f9 expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.647210:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:0.0:1787360002.647213:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360002.647217:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6f9 expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.647237:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787360002.647287:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11385:x1874182508973184:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 355us (536us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787360002.647294:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 149 00000100:00100000:3.0:1787360002.649986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.650051:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508973312 00000100:00100000:1.0:1787360002.650063:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508973312 00000100:00100000:1.0:1787360002.650196:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 150 00000100:00100000:1.0:1787360002.650208:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11385:x1874182508973312:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:1.0:1787360002.650298:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650316:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650327:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650345:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650351:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650357:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650477:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650497:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650504:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787360002.650549:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650576:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650585:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650593:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650600:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.650607:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650615:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650629:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360002.650632:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360002.650638:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650651:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650703:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650710:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650716:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650721:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.650724:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650730:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650747:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d20336700) 00010000:00010000:1.0:1787360002.650750:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360002.650753:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650759:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef416b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650772:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650778:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650790:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650795:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.650798:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650804:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650813:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360002.650815:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360002.650818:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.650823:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360002.650903:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11385:x1874182508973312:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 696us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.650912:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 150 00000100:00100000:2.0:1787360002.654054:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.654096:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508973568 00000100:00100000:1.0:1787360002.654108:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508973568 00000100:00100000:1.0:1787360002.654203:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:1.0:1787360002.654214:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11385:x1874182508973568:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360002.654502:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:11385:x1874182508973568:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 289us (453us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787360002.654510:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:3.0:1787360002.688109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.688216:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508973824 00000100:00100000:1.0:1787360002.688241:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508973824 00000100:00100000:1.0:1787360002.688309:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 151 00000100:00100000:1.0:1787360002.688321:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:11388:x1874182508973824:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360002.688348:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360002.688370:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce700 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688452:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688467:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688482:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688495:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688501:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688506:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688896:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688905:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.688933:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360002.688944:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787360002.689051:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689059:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689066:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689071:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.689076:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689084:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689097:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360002.689100:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360002.689106:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689111:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef4180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689124:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689130:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689142:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689147:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.689150:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689156:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689164:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d20336700) 00010000:00010000:1.0:1787360002.689167:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360002.689170:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689175:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689221:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689251:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.689259:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360002.689261:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360002.689264:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2e00, rc 0) 00000100:00100000:1.0:1787360002.689340:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11388:x1874182508973824:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1020us (1251us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787360002.689358:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 151 00000100:00100000:2.0:1787360002.692717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.692824:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508973952 00000100:00100000:1.0:1787360002.692837:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508973952 00000100:00100000:1.0:1787360002.692905:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 152 00000100:00100000:1.0:1787360002.692918:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11388:x1874182508973952:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:1.0:1787360002.692994:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693012:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693024:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693053:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693059:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693064:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693070:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360002.693074:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693080:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693092:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360002.693223:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360002.693241:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.693248:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef419c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360002.693365:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11388:x1874182508973952:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 450us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360002.693374:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 152 00000100:00100000:3.0:1787360002.700135:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.700276:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508974208 00000100:00100000:0.0:1787360002.700289:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508974208 00000100:00100000:0.0:1787360002.700350:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:0.0:1787360002.700361:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11388:x1874182508974208:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:0.0:1787360002.700972:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11388:x1874182508974208:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 610us (844us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787360002.700981:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:3.0:1787360002.904129:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360002.904271:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508974464 00000100:00100000:0.0:1787360002.904284:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508974464 00000100:00100000:0.0:1787360002.904363:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 153 00000100:00100000:0.0:1787360002.904377:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11419:x1874182508974464:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:0.0:1787360002.904412:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360002.904437:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef41a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce707 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.904894:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef41aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.904910:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef41aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.904921:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef41aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360002.904933:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787360002.905062:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef41a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce707 expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.905082:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef41aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce707 expref: 41 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.905090:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:0.0:1787360002.905094:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360002.905097:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41a00, rc 0) 00000100:00100000:0.0:1787360002.905342:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:11419:x1874182508974464:12345-192.168.201.14@tcp:101:cat.0 Request processed in 967us (1222us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787360002.905350:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 153 00000100:00100000:2.0:1787360002.911718:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360002.911792:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.911932:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508974848 00000100:00100000:3.0:1787360002.911944:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508974848 00000100:00100000:3.0:1787360002.912026:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:3.0:1787360002.912037:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:2363:x1874182508974848:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360002.912066:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360002.912101:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef41aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce707 expref: 41 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.912121:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:3.0:1787360002.912126:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360002.912192:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:2363:x1874182508974848:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 156us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360002.912200:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:1.0:1787360002.912380:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508974720 00000100:00100000:1.0:1787360002.912387:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508974720 00000100:00100000:1.0:1787360002.912431:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:1.0:1787360002.912439:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:11419:x1874182508974720:12345-192.168.201.14@tcp:35:cat.0 00000100:00100000:1.0:1787360002.912718:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:11419:x1874182508974720:12345-192.168.201.14@tcp:35:cat.0 Request processed in 279us (1041us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787360002.912727:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:2.0:1787360002.959218:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360002.962034:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508975104 00000100:00100000:3.0:1787360002.962054:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508975104 00000100:00100000:3.0:1787360002.962139:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 154 00000100:00100000:3.0:1787360002.962152:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:11425:x1874182508975104:12345-192.168.201.14@tcp:101:dd.0 00010000:00010000:3.0:1787360002.962180:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360002.962184:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787360002.962218:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6dd expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.962258:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:3.0:1787360002.962264:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360002.962281:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef41b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce70e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.962650:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.962698:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.962709:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.962761:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 41 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.962776:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 41 pid: 5862 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.962790:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d409b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527853056:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360002.962887:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05ae6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360002.968846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360002.968919:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508975232 00000100:00100000:1.0:1787360002.968933:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508975232 00010000:00010000:1.0:1787360002.968984:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 42 pid: 5862 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360002.969028:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d409b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527853056:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360002.969042:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:1.0:1787360002.969057:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+42:2363:x1874182508975232:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360002.969061:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969077:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360002.969087:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 42 pid: 5862 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969115:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 42 pid: 5862 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969141:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef418e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce700 expref: 42 pid: 5862 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969174:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360002.969179:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969189:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969197:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360002.969219:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360002.969267:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.969277:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360002.969296:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:2363:x1874182508975232:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 242us (459us total) trans 0 rc 0/0 00000004:00200000:0.0:1787360002.969296:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:1.0:1787360002.969308:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 66 00010000:00010000:0.0:1787360002.969468:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef41b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 42 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.969489:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360002.969497:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:0.0:1787360002.969500:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360002.969502:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346400, rc 0) 00000100:00100000:0.0:1787360002.969529:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:11425:x1874182508975104:12345-192.168.201.14@tcp:101:dd.0 Request processed in 7381us (10322us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787360002.969536:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 154 00000100:00100000:3.0:1787360002.982164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360002.983823:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508975488 00000100:00100000:2.0:1787360002.983840:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508975488 00000100:00100000:2.0:1787360002.983905:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 155 00000100:00100000:2.0:1787360002.983919:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+41:11425:x1874182508975488:12345-192.168.201.14@tcp:36:dd.0 00010000:00010000:2.0:1787360002.984269:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.984290:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360002.984313:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360002.984387:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787360002.984424:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005be80323 reply state 00000000eccbed47 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360002.984434:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360002.984545:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+44:11425:x1874182508975488:12345-192.168.201.14@tcp:36:dd.0 Request processed in 628us (2390us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787360002.984554:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 155 00000020:00080000:2.0:1787360002.984560:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787360002.995294:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.995312:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.995321:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.995328:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360002.995334:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.995341:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.995361:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:3.0:1787360002.995364:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360002.995370:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360002.995377:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef41cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360003.019412:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:3.0:1787360003.019468:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787360003.019501:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d07f179c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787360003.019506:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1e2b7400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d1107cb40 00000020:00080000:3.0:1787360003.019526:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1e2b7f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d3f8e9800 00000020:00080000:3.0:1787360003.019559:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787360003.019783:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787360003.020021:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360003.020044:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527853184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787360003.020134:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360003.020549:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527853184 00000100:00100000:3.0:1787360003.020560:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527853184 00000100:00100000:3.0:1787360003.020622:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787360003.020633:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1874182527853184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787360003.020664:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1787360003.020969:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a88f301, atime: 0x6a88f301, ctime: 0x6a88f301, blocks: 0x1 00010000:00010000:3.0:1787360003.020981:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.020999:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787360003.021003:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360003.021010:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.021027:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.021038:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.021047:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.021666:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360003.021981:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360003.021990:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.022012:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360003.022018:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.022042:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.022342:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.022351:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000094bad65/0x72f6de40e4ef41d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.022377:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360003.022378:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360003.022381:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360003.023674:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527853184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3036us (3533us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787360003.023721:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1787360003.025595:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f98d500/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787360003.025610:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527853184:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787360003.110851:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360003.146145:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360003.146189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360003.146257:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.146304:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508975616 00000100:00100000:3.0:1787360003.146325:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.146327:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508975616 00000100:00100000:0.0:1787360003.146658:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508975872 00000100:00100000:0.0:1787360003.146663:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508975872 00000100:00100000:0.0:1787360003.146756:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508975744 00000100:00100000:0.0:1787360003.146760:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508975744 00000100:00100000:0.0:1787360003.146784:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:0.0:1787360003.146794:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508975872:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360003.146873:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2365:x1874182508975872:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 80us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360003.146882:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:0.0:1787360003.146901:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:0.0:1787360003.146907:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2365:x1874182508975744:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360003.146931:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2365:x1874182508975744:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 24us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360003.146950:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00080000:0.0:1787360003.146969:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360003.147356:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 293 00000100:00100000:1.0:1787360003.147366:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508975616:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360003.147402:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182508975616:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 39us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360003.147409:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 293 00000100:00100000:3.0:1787360003.148645:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508976000 00000100:00100000:3.0:1787360003.148657:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508976000 00000100:00100000:0.0:1787360003.149278:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 147 00000100:00100000:0.0:1787360003.149298:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508976000:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360003.149370:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2365:x1874182508976000:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 82us (3046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360003.149377:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 147 00000100:00100000:0.0:1787360003.356960:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.357592:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508976128 00000100:00100000:2.0:1787360003.357605:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508976128 00000100:00100000:2.0:1787360003.357705:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 156 00000100:00100000:2.0:1787360003.357718:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11439:x1874182508976128:12345-192.168.201.14@tcp:101:stat.0 00010000:00010000:2.0:1787360003.357747:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360003.357772:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef41db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce715 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.357852:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.357870:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.357902:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.357921:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.357928:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.357935:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.360373:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.360399:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.360408:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.360459:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.360833:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 19 pid: 5861 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.360852:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a210a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527853312:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360003.361021:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e1786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360003.388876:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.389035:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508976384 00000100:00100000:1.0:1787360003.389048:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508976384 00000100:00100000:1.0:1787360003.389130:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:1.0:1787360003.389142:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:5601:x1874182508976384:12345-192.168.201.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787360003.389540:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:5601:x1874182508976384:12345-192.168.201.14@tcp:35:ldlm_bl.0 Request processed in 398us (672us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787360003.389550:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:2.0:1787360003.390553:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a210a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527853312:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360003.390588:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360003.391975:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360003.392068:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508976512 00000100:00100000:3.0:1787360003.392080:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508976512 00010000:00010000:3.0:1787360003.392125:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 21 pid: 5861 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360003.392173:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 67 00000100:00100000:3.0:1787360003.392184:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2363:x1874182508976512:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360003.392201:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360003.392209:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 21 pid: 5861 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.392232:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 21 pid: 5861 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.392257:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef41bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce70e expref: 21 pid: 5861 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.392278:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:3.0:1787360003.392284:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.392295:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.392319:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360003.392354:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360003.392421:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:2363:x1874182508976512:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 237us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360003.392429:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 67 00010000:00010000:2.0:1787360003.392711:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392719:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360003.392767:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787360003.392771:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360003.392796:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392810:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392819:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392825:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392831:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392837:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.392842:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392850:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392872:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360003.392875:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.392879:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392885:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef41e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392897:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392904:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392910:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392916:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.392919:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392925:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392932:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919a00) 00010000:00010000:2.0:1787360003.392934:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.392937:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392943:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef41e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.392990:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef41db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce715 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.393005:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce715 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.393012:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.393015:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360003.393017:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347200, rc 0) 00000100:00100000:2.0:1787360003.393057:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11439:x1874182508976128:12345-192.168.201.14@tcp:101:stat.0 Request processed in 35342us (36106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.393064:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 156 00000100:00100000:0.0:1787360003.443552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.443708:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508976768 00000100:00100000:1.0:1787360003.443720:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508976768 00000100:00100000:1.0:1787360003.443780:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 157 00000100:00100000:1.0:1787360003.443793:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11445:x1874182508976768:12345-192.168.201.14@tcp:36:truncate.0 00010000:00010000:1.0:1787360003.443855:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360003.443887:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef41f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce715 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.443907:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360003.443912:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360003.444138:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.444153:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.444186:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360003.444251:0:10018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787360003.444276:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090d437da reply state 000000005aedcefe transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360003.444285:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360003.444380:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:11445:x1874182508976768:12345-192.168.201.14@tcp:36:truncate.0 Request processed in 589us (836us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787360003.444388:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 157 00000020:00080000:1.0:1787360003.444394:0:10018:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787360003.450381:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.450401:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.450408:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.450414:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.450419:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.450428:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.450449:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.450467:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.450473:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.450492:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef41f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360003.495197:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527853440:0@lo:400:kworker.0 00000100:00100000:1.0:1787360003.495283:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360003.495367:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527853440 00000100:00100000:1.0:1787360003.495376:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527853440 00000100:00100000:1.0:1787360003.495425:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787360003.495435:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527853440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360003.495500:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527853440:12345-0@lo:400:kworker.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360003.495507:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787360003.495559:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527853440:0@lo:400:kworker.0 00000100:00100000:3.0:1787360003.496074:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527853824:0@lo:400:kworker.0 00000100:00100000:3.0:1787360003.496121:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360003.496166:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787360003.496173:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527853952:0@lo:400:kworker.0 00000100:00100000:3.0:1787360003.496200:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360003.496250:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527853952 00000100:00100000:3.0:1787360003.496255:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527853952 00000100:00100000:3.0:1787360003.496304:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787360003.496311:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527853952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360003.496355:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527853952:12345-0@lo:400:kworker.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360003.496363:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787360003.496382:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360003.496405:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527853952:0@lo:400:kworker.0 00000100:00100000:2.0:1787360003.496861:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527853824 00000100:00100000:2.0:1787360003.496867:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527853824 00000100:00100000:2.0:1787360003.496917:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787360003.496926:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527853824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360003.496975:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527853824:12345-0@lo:400:kworker.0 Request processed in 51us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.496982:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787360003.497065:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527853568:0@lo:400:kworker.0 00000100:00100000:0.0:1787360003.497113:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360003.497148:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360003.497164:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527853696:0@lo:400:kworker.0 00000100:00100000:0.0:1787360003.497188:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360003.497230:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527853568 00000100:00100000:0.0:1787360003.497234:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527853568 00000100:00100000:0.0:1787360003.497258:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527853696 00000100:00100000:0.0:1787360003.497261:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527853696 00000100:00100000:0.0:1787360003.497276:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787360003.497282:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527853568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360003.497313:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527853568:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360003.497319:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787360003.497331:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787360003.497336:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527853696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360003.497369:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527853696:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360003.497375:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787360003.497399:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527853696:0@lo:400:kworker.0 00000100:00100000:0.0:1787360003.497408:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527853568:0@lo:400:kworker.0 00000100:00080000:3.0:1787360003.498142:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360003.498252:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527853824:0@lo:400:kworker.0 00000100:00100000:0.0:1787360003.596039:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.596324:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508976896 00000100:00100000:2.0:1787360003.596338:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508976896 00000100:00100000:2.0:1787360003.596408:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 158 00000100:00100000:2.0:1787360003.596420:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11459:x1874182508976896:12345-192.168.201.14@tcp:101:stat.0 00010000:00010000:2.0:1787360003.596447:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360003.596473:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef41fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce71c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596551:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596566:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596577:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596613:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596622:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596629:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.596998:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597008:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597015:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360003.597053:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787360003.597058:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360003.597078:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597101:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597109:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597115:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597131:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597136:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.597141:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597148:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597367:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360003.597371:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.597377:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597385:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4205 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597399:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597404:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597409:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597414:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.597417:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597433:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597441:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919a00) 00010000:00010000:2.0:1787360003.597443:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.597446:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597453:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef420c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597483:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef41fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 22 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597497:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.597504:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.597507:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360003.597509:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346000, rc 0) 00000100:00100000:2.0:1787360003.597574:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:11459:x1874182508976896:12345-192.168.201.14@tcp:101:stat.0 Request processed in 1155us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.597582:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 158 00000100:00100000:3.0:1787360003.682815:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.682930:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508977152 00000100:00100000:2.0:1787360003.682943:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508977152 00000100:00100000:2.0:1787360003.683018:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 159 00000100:00100000:2.0:1787360003.683031:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:11469:x1874182508977152:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787360003.683091:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360003.683121:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef421a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce723 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360003.683419:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787360003.683848:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef421a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce723 expref: 23 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.683865:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:2.0:1787360003.683868:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360003.683874:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef421a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce723 expref: 23 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.683887:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347e00, rc 0) 00000100:00100000:2.0:1787360003.684008:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:11469:x1874182508977152:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 979us (1202us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787360003.684017:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 159 00000100:00100000:3.0:1787360003.689533:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.689648:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508977408 00000100:00100000:1.0:1787360003.689662:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508977408 00000100:00100000:1.0:1787360003.689763:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:1.0:1787360003.689775:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1056a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:11469:x1874182508977408:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360003.690305:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1056a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:11469:x1874182508977408:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 531us (781us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787360003.690314:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:0.0:1787360003.776437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.776780:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508977664 00000100:00100000:2.0:1787360003.776794:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508977664 00000100:00100000:2.0:1787360003.776863:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 160 00000100:00100000:2.0:1787360003.776875:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:11475:x1874182508977664:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787360003.776902:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360003.776927:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef4228 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce72a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.777037:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.777070:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.777092:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.777256:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.777275:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 24 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.777292:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a210700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527854080:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360003.777393:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1e178b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360003.786470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.788245:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a210700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527854080:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360003.788283:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360003.790065:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508977792 00000100:00100000:1.0:1787360003.790082:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508977792 00010000:00010000:1.0:1787360003.790139:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 25 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360003.790260:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 68 00000100:00100000:1.0:1787360003.790273:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:2362:x1874182508977792:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360003.790292:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360003.790300:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 25 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.790317:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 25 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.790344:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce71c expref: 25 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.790363:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360003.790369:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.790379:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.790387:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.790441:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360003.790514:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:2362:x1874182508977792:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 243us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360003.790522:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 68 00010000:00010000:0.0:1787360003.791409:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.791420:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360003.791441:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787360003.791624:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef4228 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.791644:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.791654:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:0.0:1787360003.791656:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360003.791659:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347c00, rc 0) 00000100:00100000:0.0:1787360003.791749:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11475:x1874182508977664:12345-192.168.201.14@tcp:101:bash.0 Request processed in 14876us (15323us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787360003.791758:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 160 00000100:00100000:3.0:1787360003.802733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.802811:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508978048 00000100:00100000:1.0:1787360003.802837:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508978048 00000100:00100000:1.0:1787360003.802916:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 161 00000100:00100000:1.0:1787360003.802929:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11475:x1874182508978048:12345-192.168.201.14@tcp:36:bash.0 00010000:00010000:1.0:1787360003.803258:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.803279:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.803291:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360003.803349:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1787360003.803376:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8507240 reply state 00000000089ed25f transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360003.803386:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360003.803559:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:11475:x1874182508978048:12345-192.168.201.14@tcp:36:bash.0 Request processed in 631us (837us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1787360003.803567:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 161 00000020:00080000:1.0:1787360003.803572:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787360003.808611:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.808652:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.808659:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.808666:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360003.808672:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.808716:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.808736:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360003.808740:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360003.808746:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.808752:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef423d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360003.814840:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360003.814957:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508978176 00000100:00100000:0.0:1787360003.814983:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508978176 00000100:00100000:0.0:1787360003.815056:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 162 00000100:00100000:0.0:1787360003.815068:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11475:x1874182508978176:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360003.815101:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360003.815126:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4244 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce731 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.815227:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.815244:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.815253:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.815294:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360003.815311:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 27 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360003.815326:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527854208:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360003.815435:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360003.820370:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360003.820540:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40996d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527854208:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360003.820589:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.820797:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508978304 00000100:00100000:2.0:1787360003.820807:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508978304 00010000:00010000:2.0:1787360003.820852:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 28 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.820900:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:2.0:1787360003.820911:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:2363:x1874182508978304:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360003.820939:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360003.820959:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 28 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.820972:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 28 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.820994:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef422f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce72a expref: 28 pid: 5861 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.821009:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.821014:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.821023:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.821030:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.821064:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360003.821117:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.821128:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.821134:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:2363:x1874182508978304:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 222us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.821144:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 69 00000004:00200000:1.0:1787360003.821190:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787360003.821196:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360003.821228:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.821278:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4244 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce731 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.821366:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce731 expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.821377:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360003.821380:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360003.821384:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:1.0:1787360003.821431:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11475:x1874182508978176:12345-192.168.201.14@tcp:101:bash.0 Request processed in 6364us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360003.821438:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 162 00000100:00100000:3.0:1787360003.826104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.826349:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508978560 00000100:00100000:1.0:1787360003.826363:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508978560 00000100:00100000:1.0:1787360003.826420:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:1.0:1787360003.826433:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11475:x1874182508978560:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:1.0:1787360003.826726:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:11475:x1874182508978560:12345-192.168.201.14@tcp:35:bash.0 Request processed in 294us (631us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787360003.826734:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:3.0:1787360003.915958:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.916090:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508978816 00000100:00100000:1.0:1787360003.916103:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508978816 00000100:00100000:1.0:1787360003.916174:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 163 00000100:00100000:1.0:1787360003.916186:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:11485:x1874182508978816:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360003.916224:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360003.916250:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce738 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360003.916532:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787360003.916740:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4252 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce738 expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.916757:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:1.0:1787360003.916760:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360003.916766:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce738 expref: 29 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360003.916779:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3600, rc 0) 00000100:00100000:1.0:1787360003.916848:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11485:x1874182508978816:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 663us (899us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787360003.916855:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 163 00000100:00100000:3.0:1787360003.918898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.918978:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508978944 00000100:00100000:2.0:1787360003.919001:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508978944 00000100:00100000:2.0:1787360003.919066:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 164 00000100:00100000:2.0:1787360003.919090:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11485:x1874182508978944:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:2.0:1787360003.919165:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919198:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919221:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919239:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919246:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919252:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919602:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919612:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919619:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360003.919662:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919704:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919712:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919728:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919734:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.919738:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919747:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919761:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360003.919764:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.919769:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919775:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919787:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919793:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919799:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919803:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.919806:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919821:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919829:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919a00) 00010000:00010000:2.0:1787360003.919831:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.919834:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919840:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef4267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919854:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919861:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919867:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919872:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.919874:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919880:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919887:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.919889:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.919892:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.919907:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef426e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.919994:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11485:x1874182508978944:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 905us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.920004:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 164 00000100:00100000:3.0:1787360003.922540:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.922633:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508979200 00000100:00100000:1.0:1787360003.922647:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508979200 00000100:00100000:1.0:1787360003.922753:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:1.0:1787360003.922765:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11485:x1874182508979200:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360003.923260:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:11485:x1874182508979200:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 495us (726us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1787360003.923269:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:3.0:1787360003.956512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.956619:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508979456 00000100:00100000:2.0:1787360003.956633:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508979456 00000100:00100000:2.0:1787360003.956733:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 165 00000100:00100000:2.0:1787360003.956746:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:11488:x1874182508979456:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787360003.956776:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360003.956800:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce73f expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.956885:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.956902:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.956916:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.956933:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.956941:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.956968:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957507:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef428a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957517:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef428a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957523:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef428a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360003.957535:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787360003.957628:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957637:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957644:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957651:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.957656:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957665:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957705:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360003.957709:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.957721:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957728:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef427c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957742:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957748:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957753:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957758:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.957761:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957766:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957773:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919a00) 00010000:00010000:2.0:1787360003.957775:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360003.957778:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957783:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef4283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957832:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce73f expref: 32 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957858:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef428a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce73f expref: 31 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.957865:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.957868:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360003.957870:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347600, rc 0) 00000100:00100000:2.0:1787360003.958001:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11488:x1874182508979456:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1258us (1498us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787360003.958011:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 165 00000100:00100000:3.0:1787360003.961560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360003.961653:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508979584 00000100:00100000:2.0:1787360003.961668:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508979584 00000100:00100000:2.0:1787360003.961759:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 166 00000100:00100000:2.0:1787360003.961771:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11488:x1874182508979584:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:2.0:1787360003.961851:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961871:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961883:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961913:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961920:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961945:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961951:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360003.961956:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961964:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.961979:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.961982:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360003.962001:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.962008:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360003.962279:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11488:x1874182508979584:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 509us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.962288:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 166 00000100:00100000:3.0:1787360003.963371:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360003.963726:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360003.963907:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508979968 00000100:00100000:1.0:1787360003.963918:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508979968 00000100:00100000:1.0:1787360003.963964:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:1.0:1787360003.963974:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11488:x1874182508979968:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360003.964229:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11488:x1874182508979968:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 255us (502us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787360003.964247:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:2.0:1787360003.965346:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508979712 00000100:00100000:2.0:1787360003.965357:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508979712 00000100:00100000:2.0:1787360003.965423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:2.0:1787360003.965433:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:2362:x1874182508979712:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360003.965449:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360003.965489:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef428a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce73f expref: 32 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360003.965528:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360003.965533:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360003.965794:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:2362:x1874182508979712:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 361us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360003.965803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:1.0:1787360004.006969:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360004.007223:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527854336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360004.007299:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360004.010310:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527854336 00000100:00100000:2.0:1787360004.010330:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527854336 00000100:00100000:2.0:1787360004.010399:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787360004.010411:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527854336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360004.010469:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360004.010574:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527854336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (3273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360004.010582:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787360004.010841:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527854336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787360004.134934:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360004.153404:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360004.153592:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508980224 00000100:00100000:1.0:1787360004.153606:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508980224 00000100:00100000:1.0:1787360004.153730:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 167 00000100:00100000:1.0:1787360004.153744:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11506:x1874182508980224:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:1.0:1787360004.153776:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360004.153806:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef429f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce746 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.153926:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef42a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.153944:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.153958:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360004.153970:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787360004.154186:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef429f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce746 expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.154216:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef42a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce746 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.154245:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:1.0:1787360004.154248:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787360004.154252:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3000, rc 0) 00000100:00100000:1.0:1787360004.154394:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11506:x1874182508980224:12345-192.168.201.14@tcp:101:cat.0 Request processed in 652us (999us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787360004.154402:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 167 00000100:00080000:3.0:1787360004.155588:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360004.179773:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360004.179886:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508980352 00000100:00100000:1.0:1787360004.179899:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508980352 00000100:00100000:1.0:1787360004.179970:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 168 00000100:00100000:1.0:1787360004.179982:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11507:x1874182508980352:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360004.180021:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360004.180048:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce74d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.180136:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef42bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.180153:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef42bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.180166:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef42bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360004.180372:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787360004.180377:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360004.180450:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef42bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.180501:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce74d expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.180518:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef42bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce74d expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.180527:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360004.180530:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360004.180534:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3400, rc 0) 00000100:00100000:1.0:1787360004.180596:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11507:x1874182508980352:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 616us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360004.180603:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 168 00000100:00100000:0.0:1787360004.187491:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360004.187592:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508980736 00000100:00100000:1.0:1787360004.187606:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508980736 00000100:00100000:1.0:1787360004.187699:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:1.0:1787360004.187711:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11507:x1874182508980736:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360004.188084:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11507:x1874182508980736:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 374us (603us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787360004.188093:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:3.0:1787360004.193543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360004.193673:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508980864 00000100:00100000:2.0:1787360004.193715:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508980864 00000100:00100000:2.0:1787360004.193803:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:2.0:1787360004.193817:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11507:x1874182508980864:12345-192.168.201.14@tcp:103:lfs.0 00010000:00010000:2.0:1787360004.193838:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787360004.193869:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef424b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce731 expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360004.193892:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef42a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce746 expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360004.193930:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef414f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6f2 expref: 33 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360004.193944:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336200) 00010000:00010000:2.0:1787360004.193957:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360004.194026:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11507:x1874182508980864:12345-192.168.201.14@tcp:103:lfs.0 Request processed in 213us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360004.194036:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:3.0:1787360004.199581:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360004.200353:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508980992 00000100:00100000:1.0:1787360004.200367:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508980992 00000100:00100000:1.0:1787360004.200451:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 169 00000100:00100000:1.0:1787360004.200465:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11507:x1874182508980992:12345-192.168.201.14@tcp:58:lfs.0 00010000:00010000:1.0:1787360004.200593:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.200626:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.200637:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360004.200960:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787360004.201286:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11507:x1874182508980992:12345-192.168.201.14@tcp:58:lfs.0 Request processed in 821us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360004.201295:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 169 00000100:00100000:3.0:1787360004.219375:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360004.219483:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508981120 00000100:00100000:1.0:1787360004.219496:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508981120 00000100:00100000:1.0:1787360004.219569:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 170 00000100:00100000:1.0:1787360004.219584:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11509:x1874182508981120:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360004.219607:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360004.219630:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef42c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce754 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.219742:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.219759:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.219772:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.219787:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.219813:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.219821:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220210:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220221:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220229:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360004.220268:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787360004.220272:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360004.220292:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220305:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220313:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220320:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220327:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220343:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360004.220348:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220356:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220372:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360004.220375:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360004.220380:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220385:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef42d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220397:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220403:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220409:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220414:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360004.220416:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220423:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220441:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d20336800) 00010000:00010000:1.0:1787360004.220444:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360004.220447:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220452:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef42d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220487:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef42c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220505:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360004.220512:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787360004.220515:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360004.220518:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2000, rc 0) 00000100:00100000:1.0:1787360004.220597:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11509:x1874182508981120:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1015us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360004.220606:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 170 00000040:00080000:3.0:1787360004.979653:0:12518:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787360004.979662:0:12518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360004.979740:0:12518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1787360004.979748:0:12518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787360005.158839:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360005.223143:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787360005.223154:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360005.223239:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1787360005.223250:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360005.223406:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527854464:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787360005.223517:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087aeb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360005.226859:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527854464:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787360005.232564:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.232749:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508981248 00000100:00100000:2.0:1787360005.232763:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508981248 00000100:00100000:2.0:1787360005.232839:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 171 00000100:00100000:2.0:1787360005.232852:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11522:x1874182508981248:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360005.232892:0:10018:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360005.233017:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11522:x1874182508981248:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 166us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.233026:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 171 00000100:00100000:3.0:1787360005.240824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.241171:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508981376 00000100:00100000:1.0:1787360005.241193:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508981376 00000100:00100000:1.0:1787360005.241262:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 172 00000100:00100000:1.0:1787360005.241274:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11522:x1874182508981376:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787360005.241358:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241378:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241400:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241420:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241428:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241435:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241466:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241475:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241482:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360005.241521:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787360005.241526:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360005.241539:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241551:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241557:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241575:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241580:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.241585:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241593:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241608:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:1.0:1787360005.241611:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360005.241616:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241622:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241638:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241645:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241651:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241656:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.241659:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241674:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241728:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff983d20336800) 00010000:00010000:1.0:1787360005.241731:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360005.241735:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241740:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef42ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241756:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241763:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241769:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241774:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.241777:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241783:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241789:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787360005.241792:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360005.241795:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.241811:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef42f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360005.241900:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11522:x1874182508981376:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 Request processed in 627us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360005.241910:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 172 00000100:00100000:0.0:1787360005.246543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.246605:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508981632 00000100:00100000:1.0:1787360005.246621:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508981632 00000100:00100000:1.0:1787360005.246732:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 173 00000100:00100000:1.0:1787360005.246746:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+33:11522:x1874182508981632:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360005.246772:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360005.246797:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce75b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.246913:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.246943:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.246955:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360005.246968:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787360005.247073:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247081:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247106:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247113:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.247118:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247128:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247142:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:1.0:1787360005.247146:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360005.247152:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247159:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247225:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce75b expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247237:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:1.0:1787360005.247240:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360005.247244:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef42fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce75b expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.247255:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2c00, rc 0) 00000100:00100000:1.0:1787360005.247320:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11522:x1874182508981632:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 577us (788us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787360005.247338:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 173 00000100:00100000:0.0:1787360005.250300:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.250403:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508981760 00000100:00100000:2.0:1787360005.250415:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508981760 00000100:00100000:2.0:1787360005.250491:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 174 00000100:00100000:2.0:1787360005.250502:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11522:x1874182508981760:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360005.250543:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360005.250964:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11522:x1874182508981760:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 461us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.250990:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 174 00000100:00100000:3.0:1787360005.253731:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.254116:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508982016 00000100:00100000:1.0:1787360005.254129:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508982016 00000100:00100000:1.0:1787360005.254215:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 175 00000100:00100000:1.0:1787360005.254229:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11522:x1874182508982016:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360005.254254:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360005.254258:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787360005.254289:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef42bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce74d expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.254310:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360005.254315:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360005.254331:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef430f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce762 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360005.255354:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787360005.255617:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.255634:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.255646:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.255740:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef430f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce762 expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.255772:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce762 expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.255781:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d20336800) 00010000:00010000:1.0:1787360005.255784:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360005.255787:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2e00, rc 0) 00000100:00100000:1.0:1787360005.255871:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11522:x1874182508982016:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1643us (2148us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787360005.255881:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 175 00000100:00100000:0.0:1787360005.260386:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.260448:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508982272 00000100:00100000:1.0:1787360005.260462:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508982272 00000100:00100000:1.0:1787360005.260598:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 176 00000100:00100000:1.0:1787360005.260611:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11522:x1874182508982272:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787360005.260715:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360005.260750:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce762 expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.260774:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d20336800) 00010000:00010000:1.0:1787360005.260785:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360005.260811:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.260827:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.260837:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.260900:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.260909:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.260931:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261452:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261462:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261470:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261477:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.261482:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261489:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261499:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360005.261502:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360005.261507:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261513:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4324 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261532:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261538:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261545:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261550:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.261553:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261559:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261567:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfd604f9b (ffff983d20336500) 00010000:00010000:1.0:1787360005.261570:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360005.261572:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.261578:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef432b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfd604f9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360005.261707:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11522:x1874182508982272:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 1068us (1301us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787360005.261717:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 176 00000100:00100000:0.0:1787360005.264531:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.264741:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508982400 00000100:00100000:2.0:1787360005.264755:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508982400 00000100:00100000:2.0:1787360005.264955:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 177 00000100:00100000:2.0:1787360005.264966:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11522:x1874182508982400:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360005.264988:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360005.265014:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce769 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.265065:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.265081:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.265093:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.265221:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 36 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.265242:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 35 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.265251:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:2.0:1787360005.265254:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360005.265258:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346c00, rc 0) 00000100:00100000:2.0:1787360005.265326:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11522:x1874182508982400:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 360us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.265340:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 177 00000100:00100000:3.0:1787360005.268773:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.269015:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508982656 00000100:00100000:2.0:1787360005.269032:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508982656 00000100:00100000:2.0:1787360005.269143:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 178 00000100:00100000:2.0:1787360005.269157:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11522:x1874182508982656:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360005.269285:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.269306:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.269321:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360005.269715:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787360005.269727:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379598048788ns, next at 380598046445ns, rc = 0 00000004:00010000:2.0:1787360005.269818:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2542bab reply state 00000000005d4d49 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.269828:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360005.269955:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:11522:x1874182508982656:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 800us (1197us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787360005.269964:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 178 00000100:00100000:0.0:1787360005.273053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.273105:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508982784 00000100:00100000:1.0:1787360005.273119:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508982784 00000100:00100000:1.0:1787360005.273202:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 179 00000100:00100000:1.0:1787360005.273343:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:11522:x1874182508982784:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360005.273386:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360005.273412:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce770 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.273480:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.273495:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.273518:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:1.0:1787360005.273521:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360005.273525:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2800, rc 0) 00000100:00100000:1.0:1787360005.273593:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11522:x1874182508982784:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 252us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360005.273780:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 179 00010000:00010000:2.0:1787360005.274757:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.274771:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.274796:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.274803:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360005.274808:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.274818:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.274835:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:2.0:1787360005.274838:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787360005.274843:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.274850:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4340 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.279519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.279640:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508982912 00000100:00100000:1.0:1787360005.279654:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508982912 00000100:00100000:1.0:1787360005.279928:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00100000:1.0:1787360005.279941:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+6:2363:x1874182508982912:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787360005.280317:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508982912:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 378us (878us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787360005.280326:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00080000:3.0:1787360005.285011:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360005.285479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360005.285625:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508983168 00000100:00100000:3.0:1787360005.285637:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508983168 00000100:00100000:3.0:1787360005.285735:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:3.0:1787360005.285747:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:11522:x1874182508983168:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787360005.286003:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11522:x1874182508983168:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 258us (530us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787360005.286012:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:3.0:1787360005.288610:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360005.289140:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508983424 00000100:00100000:1.0:1787360005.289167:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508983424 00000100:00100000:1.0:1787360005.289265:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 180 00000100:00100000:1.0:1787360005.289277:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11522:x1874182508983424:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787360005.289399:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11522:x1874182508983424:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 124us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360005.289407:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 180 00000100:00100000:3.0:1787360005.292096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.292274:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508983552 00000100:00100000:2.0:1787360005.292288:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508983552 00000100:00100000:2.0:1787360005.292362:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 181 00000100:00100000:2.0:1787360005.292376:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11522:x1874182508983552:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360005.292399:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360005.292424:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef434e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce777 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.292520:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.292538:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.292566:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360005.292606:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360005.292625:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.292652:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef434e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce777 expref: 40 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.292670:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce777 expref: 39 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.293453:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:2.0:1787360005.293457:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787360005.293462:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347600, rc 0) 00000100:00100000:2.0:1787360005.293542:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11522:x1874182508983552:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1166us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.293551:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 181 00000100:00100000:0.0:1787360005.297345:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360005.297436:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508983680 00000100:00100000:3.0:1787360005.297459:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508983680 00000100:00100000:3.0:1787360005.297531:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:3.0:1787360005.297543:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2365:x1874182508983680:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360005.297564:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360005.297588:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce77e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787360005.297617:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f304, blocks: 0x1 00010000:00010000:3.0:1787360005.297640:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1787360005.297645:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360005.297656:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360005.297875:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360005.297909:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63e00, rc 0) 00000100:00100000:3.0:1787360005.298015:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2365:x1874182508983680:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 472us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360005.298024:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:3.0:1787360005.301320:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.301525:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508983936 00000100:00100000:2.0:1787360005.301536:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508983936 00000100:00100000:2.0:1787360005.301628:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 182 00000100:00100000:2.0:1787360005.301641:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11522:x1874182508983936:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787360005.301809:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11522:x1874182508983936:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 169us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.301815:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 182 00000100:00100000:1.0:1787360005.304517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360005.304637:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984064 00000100:00100000:0.0:1787360005.304653:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984064 00000100:00100000:2.0:1787360005.304967:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:2.0:1787360005.304995:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:11522:x1874182508984064:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360005.305015:0:12078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360005.305035:0:12078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce785 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.305083:0:12078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.305093:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360005.305098:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360005.305104:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.305146:0:12078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.305162:0:12078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 9 pid: 6698 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.305177:0:12078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12078:1874182527854592:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360005.305327:0:12078:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360005.308464:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.308562:0:12078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12078:1874182527854592:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360005.308604:0:12078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.308643:0:12078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346200, rc 0) 00000100:00100000:0.0:1787360005.308767:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984192 00000100:00100000:0.0:1787360005.308775:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984192 00010000:00010000:0.0:1787360005.308809:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 10 pid: 6698 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.308839:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:0.0:1787360005.308847:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2362:x1874182508984192:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360005.308861:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360005.308881:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 10 pid: 6698 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.308892:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 10 pid: 6698 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.308911:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057266c36/0x72f6de40e4ef435c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce77e expref: 10 pid: 6698 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.308931:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360005.308934:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360005.308941:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.308949:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.308977:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.308986:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1874182527854720:192.168.201.14@tcp:105: 00000100:00100000:2.0:1787360005.310010:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:11522:x1874182508984064:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 5013us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.310021:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:0.0:1787360005.310202:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360005.319023:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.319166:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984320 00000100:00100000:2.0:1787360005.319188:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984320 00002000:00100000:2.0:1787360005.319250:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff983d3f8b7b80 x1874182508984320/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:196/0 lens 504/0 e 0 to 0 dl 1787360016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787360005.319262:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8b7b80 with x1874182508984320 ext(0->8) 00002000:00010000:2.0:1787360005.319269:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f8b7b80 00000100:00100000:2.0:1787360005.319308:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787360005.319320:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508984320:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787360005.319840:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1874182527854720:192.168.201.14@tcp:105: 00010000:00010000:0.0:1787360005.319867:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360005.320345:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182508984320:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 Request processed in 1025us (1329us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787360005.320355:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00002000:00100000:2.0:1787360005.320364:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff983d3f8b7b80 x1874182508984320/t4294967314(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:196/0 lens 504/448 e 0 to 0 dl 1787360016 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787360005.320373:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8b7b80 with x1874182508984320 ext(0->8) 00002000:00010000:2.0:1787360005.320376:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f8b7b80 00000100:00100000:1.0:1787360005.322658:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.323124:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984448 00000100:00100000:2.0:1787360005.323137:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984448 00000100:00100000:2.0:1787360005.323208:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 183 00000100:00100000:2.0:1787360005.323221:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11522:x1874182508984448:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787360005.324165:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2362:x1874182508984192:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 15311us (15703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360005.324177:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:0.0:1787360005.374252:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11522:x1874182508984448:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 Request processed in 51022us (51594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360005.374265:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 183 00000001:00080000:3.0:1787360005.374372:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000001:00080000:3.0:1787360005.374385:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:3.0:1787360005.374416:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1787360005.374421:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1787360005.374464:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1787360005.374471:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1787360005.374892:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787360005.374913:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787360005.378268:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360005.378293:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527854848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787360005.378363:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360005.381785:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.382928:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527854848 00000100:00100000:2.0:1787360005.382944:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527854848 00000100:00100000:0.0:1787360005.383285:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984576 00000100:00100000:0.0:1787360005.383306:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984576 00000100:00100000:3.0:1787360005.383579:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787360005.383594:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527854848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787360005.384113:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787360005.384118:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787360004 00002000:00010000:3.0:1787360005.384120:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787360005.384122:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787360004 -> 1787360004 00002000:00010000:3.0:1787360005.384124:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787360005.384253:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527854848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 661us (5888us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787360005.384261:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787360005.384606:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:1.0:1787360005.384617:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2364:x1874182508984576:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1787360005.387621:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787360005.387907:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3a213800/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787360005.387921:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527854848:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1787360005.436830:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787360005.436970:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1787360005.436984:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787360005.437331:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508984576:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 Request processed in 52710us (55550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360005.437343:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:1.0:1787360005.445887:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.445986:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984832 00000100:00100000:2.0:1787360005.445999:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984832 00000100:00100000:2.0:1787360005.446328:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 184 00000100:00100000:2.0:1787360005.446341:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11522:x1874182508984832:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360005.449620:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360005.449667:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347600/0x72f6de40e4ef4355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce777 expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.449706:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:2.0:1787360005.449712:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360005.449747:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.449762:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.449771:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360005.450525:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c02fe1d5 reply state 0000000068f2015e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.450538:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787360005.450756:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11522:x1874182508984832:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 4416us (5044us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787360005.450764:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 184 00000100:00100000:0.0:1787360005.454630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:1.0:1787360005.454909:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.454923:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.454932:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.454938:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360005.454944:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.454952:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.454988:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:1.0:1787360005.454991:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360005.454997:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360005.455004:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347c00/0x72f6de40e4ef436a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360005.455637:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508984960 00000100:00100000:3.0:1787360005.455651:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508984960 00000100:00100000:2.0:1787360005.456089:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 57 00000100:00100000:2.0:1787360005.456105:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508984960:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787360005.456361:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787360005.456365:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787360004 -> 1787360003 00002000:00010000:2.0:1787360005.456367:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787360001 00002000:00010000:2.0:1787360005.456370:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787360004 -> 1787360003 00002000:00010000:2.0:1787360005.456372:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787360005.456433:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508984960:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 333us (1813us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787360005.456448:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 57 00000100:00100000:1.0:1787360005.458370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360005.458447:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508985216 00000100:00100000:0.0:1787360005.458458:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508985216 00000100:00100000:0.0:1787360005.458515:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 185 00000100:00100000:0.0:1787360005.458524:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11522:x1874182508985216:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787360005.458593:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.458612:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.458622:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.458660:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 18 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.458674:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 18 pid: 10018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.458709:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527854976:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360005.458835:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360005.462974:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360005.463630:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508985344 00000100:00100000:2.0:1787360005.463643:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508985344 00010000:00010000:2.0:1787360005.463726:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 19 pid: 10018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.463767:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 71 00000100:00100000:2.0:1787360005.463780:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:2363:x1874182508985344:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360005.463800:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360005.463808:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 19 pid: 10018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.463822:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 19 pid: 10018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.463846:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:2.0:1787360005.463851:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.463875:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.463883:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.463905:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360005.463966:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:2363:x1874182508985344:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 187us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.463973:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 71 00010000:00010000:0.0:1787360005.465226:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce769 expref: 18 pid: 10018 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.465246:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527854976:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360005.465274:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465285:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465291:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465323:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465330:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465337:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465343:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360005.465348:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465355:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465370:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:0.0:1787360005.465372:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787360005.465389:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.465395:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef4371 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.465542:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:11522:x1874182508985216:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 Request processed in 7017us (7178us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787360005.465552:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 185 00000100:00100000:1.0:1787360005.467672:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360005.467857:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508985472 00000100:00100000:3.0:1787360005.467869:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508985472 00000100:00100000:3.0:1787360005.467949:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 58 00000100:00100000:3.0:1787360005.467961:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508985472:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787360005.468012:0:12078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360005.468035:0:12078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 8 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360005.468053:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360005.468058:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360005.468063:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360005.468102:0:12078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 8 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360005.468116:0:12078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 8 pid: 12078 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360005.468132:0:12078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12078:1874182527855104:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787360005.468228:0:12078:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d2033fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360005.470666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360005.470825:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508985600 00000100:00100000:0.0:1787360005.470837:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508985600 00010000:00010000:0.0:1787360005.470881:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.470933:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 72 00000100:00100000:0.0:1787360005.470943:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508985600:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360005.470959:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360005.470985:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.471001:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 9 pid: 12078 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.471031:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360005.471036:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360005.471421:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.471461:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.471484:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360005.471546:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508985600:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 604us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360005.471555:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 72 00010000:00010000:3.0:1787360005.473219:0:12078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0ab0167/0x72f6de40e4ef4363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce785 expref: 8 pid: 12078 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360005.473241:0:12078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d408e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12078:1874182527855104:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360005.473269:0:12078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473371:0:12078:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473380:0:12078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473419:0:12078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473427:0:12078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473499:0:12078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473508:0:12078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360005.473527:0:12078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473537:0:12078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473557:0:12078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.473573:0:12078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002387e192/0x72f6de40e4ef4378 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.473852:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508985472:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 Request processed in 5892us (6186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.473862:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 58 00000100:00100000:2.0:1787360005.476601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360005.476833:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508985856 00000100:00100000:3.0:1787360005.476845:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508985856 00000100:00100000:0.0:1787360005.477017:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 186 00000100:00100000:0.0:1787360005.477030:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+17:11522:x1874182508985856:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787360005.477217:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477238:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477251:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477536:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477548:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477557:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477596:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.477626:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 18 pid: 5862 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.477642:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527855232:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360005.477768:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787360005.482034:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360005.482119:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527855232:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360005.482151:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.482831:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508985984 00000100:00100000:2.0:1787360005.482840:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508985984 00010000:00010000:2.0:1787360005.482887:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 19 pid: 5862 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.482972:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 73 00000100:00100000:2.0:1787360005.482985:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:2362:x1874182508985984:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360005.483002:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360005.483011:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 19 pid: 5862 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.483052:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 19 pid: 5862 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.483077:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4347 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce770 expref: 19 pid: 5862 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.483095:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:2.0:1787360005.483100:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.483110:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.483117:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.483146:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360005.483218:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:2362:x1874182508985984:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 235us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360005.483225:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 73 00010000:00010000:0.0:1787360005.484074:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.484085:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360005.484311:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787360005.484480:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787360005.484528:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787360005.484790:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1874182527855360:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787360005.484851:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360005.484884:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360005.484912:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527855360 00000100:00100000:0.0:1787360005.484919:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527855360 00000100:00100000:0.0:1787360005.484963:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360005.484972:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1874182527855360:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787360005.485048:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d409b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1874182527855360:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360005.485071:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787360005.485124:0:5862:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787360005.485130:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3a213800, transno 4294967315 00000100:00100000:0.0:1787360005.485144:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1874182527855360:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787360005.485630:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787360005.485719:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1874182527855488:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787360005.485756:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360005.485777:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787360005.485962:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527855488 00000100:00100000:0.0:1787360005.485969:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527855488 00000100:00100000:0.0:1787360005.486004:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360005.486012:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1874182527855488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787360005.486247:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5862:x1874182527855488:12345-0@lo:1000:mdt00_001.0 Request processed in 234us (488us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787360005.486257:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360005.486300:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1874182527855488:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787360005.486467:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486478:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486486:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486492:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360005.486497:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486512:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486530:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919a00) 00010000:00010000:0.0:1787360005.486533:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360005.486538:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486544:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef4386 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486575:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486580:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486586:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486590:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360005.486593:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486603:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486611:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:0.0:1787360005.486613:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360005.486616:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486631:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef42c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486661:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486699:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486710:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486755:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.486771:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 21 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.486784:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e030000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527855616:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360005.486909:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d16b97540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360005.489793:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e030000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527855616:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360005.489831:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360005.490061:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360005.490131:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508986112 00000100:00100000:0.0:1787360005.490140:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508986112 00010000:00010000:0.0:1787360005.490188:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 22 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360005.490254:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:0.0:1787360005.490266:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:2362:x1874182508986112:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360005.490286:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360005.490295:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 22 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.490307:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 22 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.490332:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef42de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce754 expref: 22 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.490351:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:0.0:1787360005.490355:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.490364:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.490372:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.490405:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360005.490453:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2362:x1874182508986112:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 189us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360005.490460:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 74 00010000:00010000:2.0:1787360005.490733:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490742:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490755:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490774:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490780:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490786:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360005.490791:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490798:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490806:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:2.0:1787360005.490809:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360005.490813:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490818:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef438d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490830:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490836:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490841:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490846:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360005.490855:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490861:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490870:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d20336700) 00010000:00010000:2.0:1787360005.490873:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360005.490875:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.490880:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef437f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360005.491226:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11522:x1874182508985856:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 14197us (14632us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787360005.491235:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 186 00000020:00080000:2.0:1787360005.491238:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787360005.491377:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360005.491388:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360005.491890:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787360005.491900:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787360005.494171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360005.494500:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508986368 00000100:00100000:3.0:1787360005.494512:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508986368 00000100:00100000:3.0:1787360005.494725:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:3.0:1787360005.494738:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1056bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11522:x1874182508986368:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787360005.495447:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787360005.495554:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787360005.495817:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.495837:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.495849:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.495859:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.495865:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.495884:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360005.495913:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360005.495967:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360005.495977:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.495986:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360005.495991:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.496000:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.496015:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff983d25919e00) 00010000:00010000:0.0:1787360005.496018:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787360005.496023:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.496030:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef4394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360005.496057:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360005.496059:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360005.496061:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360005.496171:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1056bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:11522:x1874182508986368:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 1432us (2007us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787360005.496196:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 50 00000020:00080000:2.0:1787360005.496203:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787360006.055104:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360006.055129:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527855744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360006.055238:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360006.055514:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527855744 00000100:00100000:2.0:1787360006.055526:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527855744 00000100:00100000:2.0:1787360006.055605:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787360006.055618:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d415f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527855744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360006.055659:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360006.055737:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d415f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527855744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360006.055745:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787360006.056136:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527855744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787360006.056266:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787360006.184190:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360006.809349:0:12569:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360006.809359:0:12569:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360006.809406:0:12569:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787360006.809628:0:12569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360006.960300:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360006.960420:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508986624 00000100:00100000:0.0:1787360006.960433:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508986624 00000100:00100000:0.0:1787360006.960521:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 187 00000100:00100000:0.0:1787360006.960535:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:11539:x1874182508986624:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360006.960562:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360006.960596:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef439b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce78c expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360006.960874:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef43a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360006.960890:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef43a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360006.960905:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef43a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360006.960916:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787360006.961092:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef439b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce78c expref: 25 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360006.961111:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef43a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce78c expref: 24 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360006.961120:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360006.961123:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360006.961127:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40400, rc 0) 00000100:00100000:0.0:1787360006.961201:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11539:x1874182508986624:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 668us (912us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787360006.961209:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 187 00000100:00080000:2.0:1787360006.961413:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360006.964333:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360006.964431:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508986752 00000100:00100000:2.0:1787360006.964444:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508986752 00000100:00100000:2.0:1787360006.964514:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 188 00000100:00100000:2.0:1787360006.964527:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11539:x1874182508986752:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:2.0:1787360006.964637:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.964657:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.964668:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.964891:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.964901:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.964908:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965252:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965261:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965269:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360006.965311:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965325:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965341:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965348:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965354:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360006.965358:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965366:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965381:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360006.965384:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360006.965389:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965396:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef43b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965408:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965413:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965419:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965424:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360006.965432:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965439:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965447:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919f00) 00010000:00010000:2.0:1787360006.965449:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360006.965452:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965459:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef43b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965474:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965480:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965486:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965490:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360006.965493:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965498:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965504:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d25919500) 00010000:00010000:2.0:1787360006.965506:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360006.965514:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360006.965520:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef43be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360006.965668:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11539:x1874182508986752:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 1142us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360006.965748:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 188 00000100:00100000:0.0:1787360007.024943:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.024986:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508987008 00000100:00100000:0.0:1787360007.024999:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508987008 00000100:00100000:0.0:1787360007.025079:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 189 00000100:00100000:0.0:1787360007.025104:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+24:11542:x1874182508987008:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360007.025128:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.025163:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef43c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce793 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025249:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025265:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025277:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025295:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025302:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025309:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025671:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025713:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025721:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360007.025743:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787360007.025840:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025848:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025855:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025861:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.025865:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025874:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025887:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360007.025891:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360007.025895:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025902:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef43cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025912:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025918:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025934:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025939:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.025943:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025949:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025958:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d09750d00) 00010000:00010000:0.0:1787360007.025960:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360007.025963:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.025968:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.026009:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef43c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 27 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.026024:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 26 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.026031:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:0.0:1787360007.026033:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360007.026035:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:0.0:1787360007.026099:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11542:x1874182508987008:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 998us (1164us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787360007.026117:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 189 00000100:00100000:3.0:1787360007.031508:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.031551:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508987136 00000100:00100000:3.0:1787360007.031563:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508987136 00000100:00100000:3.0:1787360007.031624:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 190 00000100:00100000:3.0:1787360007.031636:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11542:x1874182508987136:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:3.0:1787360007.031734:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031755:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031786:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031816:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031823:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031830:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031837:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360007.031842:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031851:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031865:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:3.0:1787360007.031868:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360007.031874:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.031882:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef43e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360007.031955:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11542:x1874182508987136:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 320us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.031965:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 190 00000100:00100000:2.0:1787360007.042793:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.042833:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508987392 00000100:00100000:2.0:1787360007.042844:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508987392 00000100:00100000:2.0:1787360007.042905:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:2.0:1787360007.042916:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11542:x1874182508987392:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787360007.043172:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:11542:x1874182508987392:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 257us (388us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787360007.043181:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:3.0:1787360007.076004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.076770:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508987648 00000100:00100000:0.0:1787360007.076785:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508987648 00000100:00100000:0.0:1787360007.076911:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 191 00000100:00100000:0.0:1787360007.076924:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:11068:x1874182508987648:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360007.076955:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.076977:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef43ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce79a expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.077098:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.077112:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 28 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.077118:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.077162:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 28 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.077177:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 28 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.077195:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e031c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527855872:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360007.077303:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787360007.079752:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.079832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508987776 00000100:00100000:1.0:1787360007.079842:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508987776 00010000:00010000:1.0:1787360007.079882:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 29 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.079911:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:1.0:1787360007.079918:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:2363:x1874182508987776:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360007.079930:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360007.079944:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 29 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.079966:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 29 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.079988:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:1.0:1787360007.079992:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.079999:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.080005:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.080026:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360007.080072:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:2363:x1874182508987776:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.080077:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 75 00010000:00010000:0.0:1787360007.080648:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef43da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce793 expref: 28 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.080698:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e031c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527855872:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360007.080721:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.080729:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.080733:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360007.080747:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787360007.080876:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef43ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 29 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.080887:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 28 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.080893:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:0.0:1787360007.080894:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360007.080896:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41000, rc 0) 00000100:00100000:0.0:1787360007.080976:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11068:x1874182508987648:12345-192.168.201.14@tcp:101:bash.0 Request processed in 4056us (4983us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787360007.080982:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 191 00000100:00100000:3.0:1787360007.085467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.085613:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988032 00000100:00100000:0.0:1787360007.085628:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988032 00000100:00100000:0.0:1787360007.085733:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 192 00000100:00100000:0.0:1787360007.085747:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11068:x1874182508988032:12345-192.168.201.14@tcp:36:bash.0 00010000:00010000:0.0:1787360007.086184:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.086204:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.086218:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360007.086279:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787360007.086305:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000222c3e15 reply state 00000000ce2168ac transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.086315:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787360007.086365:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787360007.086542:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11068:x1874182508988032:12345-192.168.201.14@tcp:36:bash.0 Request processed in 795us (1081us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787360007.086550:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 192 00000020:00080000:0.0:1787360007.086557:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787360007.094396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:2.0:1787360007.094988:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.095003:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.095012:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.095019:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.095026:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.095054:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.095076:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:2.0:1787360007.095079:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360007.095085:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.095091:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4404 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.098434:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988160 00000100:00100000:0.0:1787360007.098452:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988160 00000100:00100000:0.0:1787360007.098588:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 193 00000100:00100000:0.0:1787360007.098603:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11068:x1874182508988160:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360007.098630:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.098659:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef440b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7a1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.098760:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef440b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a1 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.098800:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef440b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a1 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.098824:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:0.0:1787360007.098827:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360007.098832:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787360007.098897:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11068:x1874182508988160:12345-192.168.201.14@tcp:101:bash.0 Request processed in 298us (4511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.098905:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 193 00000100:00100000:3.0:1787360007.102074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.102236:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988288 00000100:00100000:0.0:1787360007.102249:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988288 00000100:00100000:0.0:1787360007.102434:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:0.0:1787360007.102449:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:11068:x1874182508988288:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360007.102470:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.102496:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7a8 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360007.102527:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a88f303, atime: 0x6a88f301, ctime: 0x6a88f303, blocks: 0xb 00010000:00010000:0.0:1787360007.102557:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1787360007.102562:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360007.102581:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.102602:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.102635:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:0.0:1787360007.102725:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:11068:x1874182508988288:12345-192.168.201.14@tcp:101:bash.0 Request processed in 280us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.102733:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00080000:2.0:1787360007.103870:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360007.105906:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.106019:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988416 00000100:00100000:2.0:1787360007.106032:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988416 00002000:00010000:2.0:1787360007.106079:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787360007.106084:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d408e0380 with x1874182508988416 ext(0->18446744073709551615) 00002000:00010000:2.0:1787360007.106098:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d408e0380. 00000100:00100000:2.0:1787360007.106172:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:2.0:1787360007.106184:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508988416:12345-192.168.201.14@tcp:10:bash.0 00002000:00010000:2.0:1787360007.106493:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787360007.106497:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787360003 -> 1787360006 00002000:00010000:2.0:1787360007.106500:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787360001 -> 1787360001 00002000:00010000:2.0:1787360007.106502:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787360003 -> 1787360006 00002000:00010000:2.0:1787360007.106505:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787360007.106584:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508988416:12345-192.168.201.14@tcp:10:bash.0 Request processed in 400us (685us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787360007.106593:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00002000:00010000:2.0:1787360007.106611:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787360007.106614:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d408e0380 with x1874182508988416 ext(0->18446744073709551615) 00002000:00010000:2.0:1787360007.106619:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d408e0380. 00000100:00100000:1.0:1787360007.163203:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.163327:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988544 00000100:00100000:2.0:1787360007.163341:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988544 00000100:00100000:2.0:1787360007.163418:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 194 00000100:00100000:2.0:1787360007.163430:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11556:x1874182508988544:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:2.0:1787360007.163518:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163540:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163552:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163580:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163588:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163595:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163955:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163965:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.163973:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360007.164173:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164187:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164195:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164203:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164209:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.164214:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164223:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164237:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360007.164241:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360007.164246:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164253:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4419 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164268:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164383:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164396:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164402:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.164405:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164412:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164421:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919500) 00010000:00010000:2.0:1787360007.164423:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360007.164426:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164432:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef4420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164448:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164454:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164459:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164464:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.164467:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164483:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164491:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:2.0:1787360007.164493:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360007.164497:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.164503:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.164596:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11556:x1874182508988544:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 1165us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360007.164605:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 194 00000100:00100000:0.0:1787360007.201760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.201855:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988800 00000100:00100000:1.0:1787360007.201868:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988800 00000100:00100000:1.0:1787360007.201937:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 195 00000100:00100000:1.0:1787360007.201949:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+32:11559:x1874182508988800:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360007.201972:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360007.201996:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef442e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7af expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202193:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202223:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202235:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202252:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202259:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202265:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202591:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202602:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.202610:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360007.202620:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787360007.203704:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203719:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203728:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203734:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.203739:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203747:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203766:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360007.203769:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360007.203774:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203781:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef4435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203814:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203820:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203826:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203831:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.203834:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203840:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203848:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d20336500) 00010000:00010000:0.0:1787360007.203850:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360007.203853:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203859:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef443c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203911:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef442e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7af expref: 35 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203928:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7af expref: 34 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.203947:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:0.0:1787360007.203949:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360007.203952:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3a00, rc 0) 00000100:00100000:0.0:1787360007.204139:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11559:x1874182508988800:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 2190us (2387us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787360007.204158:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 195 00000100:00100000:1.0:1787360007.206528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:0.0:1787360007.206820:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360007.206890:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508988928 00000100:00100000:2.0:1787360007.206901:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508988928 00000100:00100000:2.0:1787360007.206982:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 196 00000100:00100000:2.0:1787360007.206994:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11559:x1874182508988928:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:2.0:1787360007.207070:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.207090:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 34 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.207100:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.207135:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 34 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.207179:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 34 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.207194:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a211880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527856000:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360007.207299:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05ae6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360007.210049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.210082:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508989184 00000100:00100000:3.0:1787360007.210091:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508989184 00000100:00100000:3.0:1787360007.210141:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00100000:3.0:1787360007.210162:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:5601:x1874182508989184:12345-192.168.201.14@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787360007.210489:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:5601:x1874182508989184:12345-192.168.201.14@tcp:35:ldlm_bl.0 Request processed in 338us (445us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787360007.210497:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00100000:3.0:1787360007.212530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.212631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508989312 00000100:00100000:1.0:1787360007.212643:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508989312 00010000:00010000:1.0:1787360007.212718:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 36 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.212774:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:1.0:1787360007.212783:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:2363:x1874182508989312:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360007.212802:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360007.212810:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 36 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.212824:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 36 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.212849:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:1.0:1787360007.212855:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.212866:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.212875:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.212895:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360007.212938:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:2363:x1874182508989312:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 156us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.212946:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 76 00010000:00010000:2.0:1787360007.215958:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef43f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce79a expref: 35 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.215989:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a211880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1874182527856000:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360007.216218:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216232:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216238:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216276:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216285:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216292:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216299:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.216320:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216329:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216349:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:2.0:1787360007.216353:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787360007.216358:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.216364:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.216597:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11559:x1874182508988928:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 9602us (10073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360007.216608:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 196 00000100:00100000:3.0:1787360007.219287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.219369:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508989568 00000100:00100000:2.0:1787360007.219382:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508989568 00000100:00100000:2.0:1787360007.219457:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:2.0:1787360007.219470:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+34:11559:x1874182508989568:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787360007.219784:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11559:x1874182508989568:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 316us (506us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787360007.219793:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:1.0:1787360007.242920:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.243062:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508989696 00000100:00100000:2.0:1787360007.243075:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508989696 00002000:00100000:2.0:1787360007.243135:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff983d27f4fb80 x1874182508989696/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:198/0 lens 496/0 e 0 to 0 dl 1787360018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787360007.243159:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d27f4fb80 with x1874182508989696 ext(0->7) 00002000:00010000:2.0:1787360007.243181:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d27f4fb80 00000100:00100000:2.0:1787360007.243222:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:2.0:1787360007.243234:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508989696:12345-192.168.201.14@tcp:4:bash.0 00000100:00100000:2.0:1787360007.243727:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2362:x1874182508989696:12345-192.168.201.14@tcp:4:bash.0 Request processed in 493us (816us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787360007.243737:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00002000:00100000:2.0:1787360007.243745:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff983d27f4fb80 x1874182508989696/t4294967319(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:198/0 lens 496/448 e 0 to 0 dl 1787360018 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787360007.243754:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d27f4fb80 with x1874182508989696 ext(0->7) 00002000:00010000:2.0:1787360007.243758:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d27f4fb80 00000100:00100000:1.0:1787360007.246640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.246798:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508989824 00000100:00100000:3.0:1787360007.246811:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508989824 00000100:00100000:3.0:1787360007.246883:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:3.0:1787360007.246895:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2362:x1874182508989824:12345-192.168.201.14@tcp:16:kworker.0 00000001:00080000:0.0:1787360007.303992:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1787360007.304009:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000100:00100000:3.0:1787360007.304956:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182508989824:12345-192.168.201.14@tcp:16:kworker.0 Request processed in 58053us (58316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.304971:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:0.0:1787360007.309590:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.309712:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508990080 00000100:00100000:2.0:1787360007.309724:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508990080 00000100:00100000:2.0:1787360007.309781:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 197 00000100:00100000:2.0:1787360007.309789:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+35:11570:x1874182508990080:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:2.0:1787360007.309812:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360007.309831:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7b6 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.309901:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.309913:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.309923:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.309935:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.309949:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.309956:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310271:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef446d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310281:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef446d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310288:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef446d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360007.310297:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787360007.310382:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310388:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310392:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310397:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.310401:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310406:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310425:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360007.310427:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360007.310430:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310435:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346c00/0x72f6de40e4ef445f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310444:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310447:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310450:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310454:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.310455:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310458:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310462:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919500) 00010000:00010000:2.0:1787360007.310463:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360007.310465:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310467:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347800/0x72f6de40e4ef4466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310506:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346200/0x72f6de40e4ef4458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7b6 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310516:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef446d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7b6 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.310521:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:2.0:1787360007.310522:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360007.310524:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346800, rc 0) 00000100:00100000:2.0:1787360007.311887:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:11570:x1874182508990080:12345-192.168.201.14@tcp:101:cat.0 Request processed in 2089us (2296us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787360007.311898:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 197 00000100:00100000:1.0:1787360007.316845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.316889:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508990336 00000100:00100000:2.0:1787360007.316904:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508990336 00000100:00100000:2.0:1787360007.316974:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:2.0:1787360007.316988:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:11570:x1874182508990336:12345-192.168.201.14@tcp:35:cat.0 00000100:00100000:2.0:1787360007.317244:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11570:x1874182508990336:12345-192.168.201.14@tcp:35:cat.0 Request processed in 257us (405us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787360007.317252:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 54 00000100:00100000:1.0:1787360007.330658:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.330847:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508990592 00000100:00100000:0.0:1787360007.330862:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508990592 00000100:00100000:0.0:1787360007.330974:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 198 00000100:00100000:0.0:1787360007.330987:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11571:x1874182508990592:12345-192.168.201.14@tcp:36:rm.0 00010000:00010000:0.0:1787360007.331057:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787360007.331087:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef446d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7b6 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331104:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7af expref: 37 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331112:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef440b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a1 expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331120:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750800) 00010000:00010000:0.0:1787360007.331135:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360007.331173:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331189:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331200:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331211:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331216:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331220:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331515:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331523:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.331529:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787360007.332224:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787360007.332234:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381660556312ns, next at 382660554145ns, rc = 0 00010000:00010000:0.0:1787360007.332296:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332316:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332324:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332333:0:5862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332339:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332346:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332372:0:5862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360007.332394:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332401:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332407:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332413:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.332418:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332426:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332428:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360007.332435:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332441:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360007.332448:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332449:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750f00) 00010000:00010000:0.0:1787360007.332452:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787360007.332454:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332456:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332463:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff983d09750f00) 00010000:00010000:0.0:1787360007.332463:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4489 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332465:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787360007.332468:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332473:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4490 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332481:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332485:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360007.332487:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360007.332487:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.332489:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360007.332493:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332498:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.332501:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332507:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332514:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360007.332516:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360007.332518:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.332539:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef447b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360007.332560:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077cc16db reply state 0000000035d609bb transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.332569:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360007.332663:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+37:11571:x1874182508990592:12345-192.168.201.14@tcp:36:rm.0 Request processed in 1676us (2012us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787360007.332671:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 198 00010000:00010000:1.0:1787360007.337725:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.337748:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.337758:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.337764:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360007.337769:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.337793:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.337813:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d09750600) 00010000:00010000:1.0:1787360007.337816:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360007.337822:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.337828:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef4482 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.377697:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.377804:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508990848 00000100:00100000:0.0:1787360007.377818:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508990848 00000100:00100000:0.0:1787360007.377890:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 199 00000100:00100000:0.0:1787360007.377903:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+36:11577:x1874182508990848:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360007.377941:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.377967:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4497 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7bd expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.378118:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.378136:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.378157:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.378173:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.378181:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.378206:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787360007.379127:0:10018:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787360007.379396:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379462:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379470:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379502:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379507:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379513:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379517:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360007.379520:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379525:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379534:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360007.379536:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360007.379545:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379549:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef449e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360007.379560:0:10018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfe32cfc reply state 0000000077b7b7bf transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.379568:0:10018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787360007.379600:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 39 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379614:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 38 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.379622:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:0.0:1787360007.379624:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360007.379627:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787360007.379852:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11577:x1874182508990848:12345-192.168.201.14@tcp:101:bash.0 Request processed in 1950us (2184us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787360007.379861:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 199 00010000:00010000:3.0:1787360007.386803:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.386821:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.386846:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.386853:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360007.386858:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.386866:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.386884:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d09750800) 00010000:00010000:3.0:1787360007.386887:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360007.386892:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.386897:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40a00/0x72f6de40e4ef44a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.390324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.390438:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508990976 00000100:00100000:0.0:1787360007.390452:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508990976 00000100:00100000:0.0:1787360007.390544:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 61 00000100:00100000:0.0:1787360007.390557:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508990976:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360007.390577:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.390605:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7c4 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360007.390655:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360007.390701:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:0.0:1787360007.390707:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360007.390719:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.390739:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 8 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.390756:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41800, rc 0) 00000100:00100000:0.0:1787360007.390825:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508990976:12345-192.168.201.14@tcp:101:bash.0 Request processed in 270us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.390834:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 61 00000100:00080000:3.0:1787360007.391116:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360007.394995:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.395182:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508991104 00000100:00100000:2.0:1787360007.395195:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508991104 00000100:00100000:2.0:1787360007.395265:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:2.0:1787360007.395277:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:11577:x1874182508991104:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787360007.395296:0:12078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360007.395318:0:12078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7cb expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.395371:0:12078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.395381:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360007.395385:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360007.395390:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.395442:0:12078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 9 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.395457:0:12078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 9 pid: 6701 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.395471:0:12078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12078:1874182527856128:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360007.395579:0:12078:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05ae60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360007.400109:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.400397:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508991232 00000100:00100000:1.0:1787360007.400410:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508991232 00010000:00010000:1.0:1787360007.400476:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 10 pid: 6701 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.400528:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:1.0:1787360007.400540:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2362:x1874182508991232:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360007.400559:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360007.400594:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 10 pid: 6701 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.400612:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 10 pid: 6701 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.400660:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360007.400665:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360007.400700:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 10 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.400712:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 10 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.400761:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 10 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.400776:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527856256:192.168.201.14@tcp:105: 00000100:00100000:1.0:1787360007.400864:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3a0283c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787360007.401920:0:12078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef44ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7c4 expref: 10 pid: 6701 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.401942:0:12078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12078:1874182527856128:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360007.401973:0:12078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 9 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.401986:0:12078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346c00, rc 0) 00000100:00100000:0.0:1787360007.402135:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:11577:x1874182508991104:12345-192.168.201.14@tcp:101:bash.0 Request processed in 6858us (7149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.402171:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:2.0:1787360007.406970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.407877:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5847:1874182527856256:192.168.201.14@tcp:105: 00010000:00010000:1.0:1787360007.407905:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360007.407969:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508991232:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 7430us (7869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.407981:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:3.0:1787360007.409552:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508991488 00000100:00100000:3.0:1787360007.409568:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508991488 00000100:00100000:2.0:1787360007.409739:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 55 00000100:00100000:2.0:1787360007.409752:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+38:11577:x1874182508991488:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:2.0:1787360007.410078:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11577:x1874182508991488:12345-192.168.201.14@tcp:35:bash.0 Request processed in 329us (3118us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787360007.410085:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 55 00000040:00080000:0.0:1787360007.526956:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360007.526966:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360007.527214:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787360007.527221:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360007.599520:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.602356:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508991616 00000100:00100000:1.0:1787360007.602375:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508991616 00000100:00100000:1.0:1787360007.602475:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 200 00000100:00100000:1.0:1787360007.602489:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+39:11593:x1874182508991616:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360007.602520:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360007.602545:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef44c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7d2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.602635:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef44cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.602652:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef44cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.602664:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef44cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360007.602761:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787360007.602765:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360007.602790:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef44cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.602817:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef44c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7d2 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.602840:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef44cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7d2 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.602849:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360007.602852:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360007.602855:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3000, rc 0) 00000100:00100000:1.0:1787360007.602926:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:11593:x1874182508991616:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 440us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.602933:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 200 00000100:00100000:1.0:1787360007.618314:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.618485:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508991872 00000100:00100000:0.0:1787360007.618501:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508991872 00000100:00100000:0.0:1787360007.618584:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 201 00000100:00100000:0.0:1787360007.618598:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+40:11593:x1874182508991872:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360007.618625:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360007.618654:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef44d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7d9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.618806:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef44dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.618822:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef44dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.618835:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef44dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360007.618848:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787360007.618975:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef44d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7d9 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.618993:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef44dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7d9 expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.619021:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:0.0:1787360007.619024:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787360007.619028:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41000, rc 0) 00000100:00100000:0.0:1787360007.619116:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+42:11593:x1874182508991872:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 520us (815us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787360007.619126:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 201 00000100:00100000:1.0:1787360007.625287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.625507:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508992128 00000100:00100000:3.0:1787360007.625521:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508992128 00000100:00100000:3.0:1787360007.625592:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 202 00000100:00100000:3.0:1787360007.625605:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+42:11593:x1874182508992128:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360007.625632:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360007.625658:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef44eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7e0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.625825:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef44f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.625842:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef44f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.625855:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef44f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360007.625870:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787360007.626025:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef44eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e0 expref: 45 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.626046:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef44f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e0 expref: 44 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.626056:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:3.0:1787360007.626059:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787360007.626062:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63e00, rc 0) 00000100:00100000:3.0:1787360007.626120:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+44:11593:x1874182508992128:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 517us (844us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787360007.626128:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 202 00000100:00100000:2.0:1787360007.632467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.632522:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.633820:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508992384 00000100:00100000:0.0:1787360007.633836:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508992384 00000100:00100000:0.0:1787360007.633902:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:0.0:1787360007.633914:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508992384:12345-192.168.201.14@tcp:1:lfs.0 00010000:00010000:0.0:1787360007.634028:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.634053:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 8 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.634064:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360007.634068:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360007.634074:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.634116:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 8 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.634132:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 8 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.634170:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1874182527856384:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360007.634332:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1289d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360007.634348:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508992256 00000100:00100000:3.0:1787360007.634354:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508992256 00000100:00100000:3.0:1787360007.634399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:3.0:1787360007.634409:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+44:2362:x1874182508992256:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360007.634422:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360007.634453:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef44dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7d9 expref: 44 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.634473:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:3.0:1787360007.634478:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360007.634511:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+43:2362:x1874182508992256:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 103us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.634519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:1.0:1787360007.644025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.644071:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508992512 00000100:00100000:1.0:1787360007.644082:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508992512 00002000:00100000:1.0:1787360007.644138:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff983d27f27480 x1874182508992512/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:198/0 lens 504/0 e 0 to 0 dl 1787360018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360007.644159:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d27f27480 with x1874182508992512 ext(0->8) 00010000:00010000:1.0:1787360007.644171:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 9 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.644188:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 9 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360007.644196:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d27f27480 00000100:00100000:1.0:1787360007.644230:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:1.0:1787360007.644240:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182508992512:12345-192.168.201.14@tcp:4:lfs.0 00000100:00100000:2.0:1787360007.644389:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6698:1874182527856384:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360007.644422:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.647631:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182508992512:12345-192.168.201.14@tcp:4:lfs.0 Request processed in 3379us (3602us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787360007.647647:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00002000:00100000:1.0:1787360007.647663:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff983d27f27480 x1874182508992512/t4294967308(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:198/0 lens 504/448 e 0 to 0 dl 1787360018 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360007.647691:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d27f27480 with x1874182508992512 ext(0->8) 00010000:00010000:1.0:1787360007.647704:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 11 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.647725:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 11 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360007.647744:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff983d27f27480 00000100:00100000:1.0:1787360007.655586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.655629:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508992640 00000100:00100000:1.0:1787360007.655642:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508992640 00010000:00010000:1.0:1787360007.655713:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 11 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.655758:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 78 00000100:00100000:1.0:1787360007.655771:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2365:x1874182508992640:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360007.655790:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787360007.655811:0:8457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787360007.655815:0:8457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787360006 00002000:00010000:1.0:1787360007.655817:0:8457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787360006 00002000:00010000:1.0:1787360007.655819:0:8457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787360006 00010000:00010000:1.0:1787360007.655826:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 11 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.655842:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 11 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.655868:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef44c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7cb expref: 11 pid: 12078 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.655887:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360007.655892:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360007.655912:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.655924:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.655953:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360007.656010:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2365:x1874182508992640:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 241us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.656019:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 78 00010000:00010000:1.0:1787360007.657429:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657600:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657639:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657649:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657659:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657667:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360007.657672:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657713:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657734:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.657742:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4500 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.657842:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508992384:12345-192.168.201.14@tcp:1:lfs.0 Request processed in 23926us (25315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.657853:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:1.0:1787360007.663824:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.665234:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508992896 00000100:00100000:3.0:1787360007.665252:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508992896 00000100:00100000:3.0:1787360007.665346:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 56 00000100:00100000:3.0:1787360007.665360:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10569c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+43:11593:x1874182508992896:12345-192.168.201.14@tcp:35:lfs.0 00000004:00010000:3.0:1787360007.665439:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef44f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e0 expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360007.665755:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787360007.665806:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787360007.666162:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787360007.666222:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.666240:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 47 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.666250:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.666294:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 47 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.666331:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 47 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360007.666348:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d408e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1874182527856512:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787360007.666448:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e44540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360007.668646:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d408e1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1874182527856512:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360007.668646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.668790:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508993024 00000100:00100000:0.0:1787360007.668800:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508993024 00010000:00010000:0.0:1787360007.668847:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 48 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360007.668897:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:0.0:1787360007.668910:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+48:2362:x1874182508993024:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360007.669056:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669157:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360007.669167:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 48 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669182:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 48 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669210:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40200/0x72f6de40e4ef44ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7bd expref: 48 pid: 10018 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669228:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:0.0:1787360007.669234:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669244:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669284:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360007.669316:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360007.669375:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+47:2362:x1874182508993024:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 467us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360007.669385:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 79 00010000:00010000:2.0:1787360007.669509:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.669516:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787360007.669634:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787360007.670255:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787360007.670390:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a213480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527856640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787360007.670452:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360007.670494:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0676ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360007.670772:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527856640 00000100:00100000:3.0:1787360007.670782:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527856640 00000100:00100000:3.0:1787360007.670836:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787360007.670847:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5864:x1874182527856640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787360007.670940:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5864:x1874182527856640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.670948:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360007.671359:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a213480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527856640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787360007.672169:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787360007.672252:0:5864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a213480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527856768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787360007.672372:0:5864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360007.672444:0:5864:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05ae60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360007.672489:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527856768 00000100:00100000:0.0:1787360007.672497:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527856768 00000100:00100000:0.0:1787360007.672537:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787360007.672547:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5864:x1874182527856768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787360007.673030:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5864:x1874182527856768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 481us (655us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787360007.673039:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787360007.673112:0:5864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a213480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1874182527856768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787360007.673191:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787360007.673232:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.673244:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.673252:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.673258:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360007.673263:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.673340:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.673363:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:2.0:1787360007.673366:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787360007.673372:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.673378:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62200/0x72f6de40e4ef4507 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787360007.673563:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787360007.673920:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787360007.674008:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382002329589ns, next at 383002327035ns, rc = 0 00000001:00080000:2.0:1787360007.674016:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787360007.674055:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d09750700) 00010000:00010000:2.0:1787360007.674058:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787360007.674075:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63e00/0x72f6de40e4ef44f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e0 expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.674244:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10569c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:11593:x1874182508992896:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 8886us (10429us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787360007.674255:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 56 00000020:00080000:2.0:1787360007.674260:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787360007.687434:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.687530:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508993152 00000100:00100000:1.0:1787360007.687547:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508993152 00000100:00100000:1.0:1787360007.687629:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 203 00000100:00100000:1.0:1787360007.687643:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+50:11593:x1874182508993152:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360007.687701:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360007.687740:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef450e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7e7 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.687812:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef450e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e7 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.687844:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef450e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e7 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.687870:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360007.687873:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360007.687878:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3800, rc 0) 00000100:00100000:1.0:1787360007.687955:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:11593:x1874182508993152:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 314us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360007.687963:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 203 00000100:00100000:2.0:1787360007.701547:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.701662:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508993408 00000100:00100000:1.0:1787360007.701860:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508993408 00000100:00100000:1.0:1787360007.702030:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 57 00000100:00100000:1.0:1787360007.702045:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+51:11593:x1874182508993408:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:1.0:1787360007.702334:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:11593:x1874182508993408:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 291us (797us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787360007.702342:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 57 00000001:00080000:1.0:1787360007.726854:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787360007.726878:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:1.0:1787360007.799917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.800012:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508993536 00000100:00100000:3.0:1787360007.800026:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508993536 00000100:00100000:3.0:1787360007.800105:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 204 00000100:00100000:3.0:1787360007.800119:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:11603:x1874182508993536:12345-192.168.201.14@tcp:34:lfs.0 00010000:00010000:3.0:1787360007.800227:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800329:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800344:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800362:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800383:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800390:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800495:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800504:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800511:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360007.800557:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800979:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800989:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.800997:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801003:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360007.801007:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801014:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801038:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:3.0:1787360007.801042:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360007.801048:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801055:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef4515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801069:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801075:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801081:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801086:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360007.801088:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801095:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801101:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d0947c700) 00010000:00010000:3.0:1787360007.801103:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360007.801106:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801112:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef451c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801151:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801158:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801164:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801169:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360007.801172:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801178:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801185:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:3.0:1787360007.801187:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360007.801190:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.801195:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef4523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360007.801468:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:11603:x1874182508993536:12345-192.168.201.14@tcp:34:lfs.0 Request processed in 1350us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360007.801476:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 204 00000100:00100000:2.0:1787360007.843851:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.843926:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508993792 00000100:00100000:1.0:1787360007.843940:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508993792 00000100:00100000:1.0:1787360007.844076:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 205 00000100:00100000:1.0:1787360007.844091:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+52:11606:x1874182508993792:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360007.844115:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360007.844154:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef452a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7ee expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844328:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844346:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844360:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844380:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844388:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844466:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844816:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef453f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844827:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef453f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844836:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef453f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360007.844848:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787360007.844951:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844958:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844977:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844984:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360007.844988:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.844997:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845089:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360007.845092:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360007.845098:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845104:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845121:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845128:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845134:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845150:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360007.845153:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845171:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845179:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d20336800) 00010000:00010000:1.0:1787360007.845181:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360007.845184:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845189:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845234:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef452a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7ee expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845331:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef453f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7ee expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.845339:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360007.845341:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360007.845344:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3400, rc 0) 00000100:00100000:1.0:1787360007.845497:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:11606:x1874182508993792:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1409us (1653us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787360007.845506:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 205 00000100:00100000:0.0:1787360007.850568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360007.852229:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508993920 00000100:00100000:3.0:1787360007.852247:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508993920 00000100:00100000:3.0:1787360007.852443:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 206 00000100:00100000:3.0:1787360007.852459:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:11606:x1874182508993920:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:3.0:1787360007.852551:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852594:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852609:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852643:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852651:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852658:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852696:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360007.852702:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852711:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852726:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:3.0:1787360007.852729:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360007.852735:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360007.852741:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef454d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360007.852829:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:11606:x1874182508993920:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 373us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360007.852843:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 206 00000100:00100000:2.0:1787360007.856803:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360007.857025:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508994176 00000100:00100000:0.0:1787360007.857039:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508994176 00000100:00100000:0.0:1787360007.857109:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 58 00000100:00100000:0.0:1787360007.857122:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+54:11606:x1874182508994176:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:0.0:1787360007.857547:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:11606:x1874182508994176:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 426us (752us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787360007.857555:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 58 00000100:00100000:0.0:1787360007.975966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360007.976100:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508994432 00000100:00100000:2.0:1787360007.976115:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508994432 00000100:00100000:2.0:1787360007.976200:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 207 00000100:00100000:2.0:1787360007.976212:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+55:11616:x1874182508994432:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787360007.976241:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360007.976246:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787360007.976404:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef44cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7d2 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.976434:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360007.976441:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360007.976459:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef4554 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7f5 expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.976589:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef455b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.976605:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.976616:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef455b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360007.976628:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787360007.976961:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef4554 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7f5 expref: 57 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.976978:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef455b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7f5 expref: 56 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360007.976986:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360007.976989:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360007.976993:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346400, rc 0) 00000100:00100000:2.0:1787360007.977070:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:11616:x1874182508994432:12345-192.168.201.14@tcp:101:bash.0 Request processed in 860us (1113us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787360007.977079:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 207 00000100:00100000:2.0:1787360007.996532:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360007.998125:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508994688 00000100:00100000:1.0:1787360007.998152:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508994688 00000100:00100000:1.0:1787360007.998237:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 208 00000100:00100000:1.0:1787360007.998250:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:11616:x1874182508994688:12345-192.168.201.14@tcp:36:bash.0 00010000:00010000:1.0:1787360007.998346:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787360007.998380:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef455b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7f5 expref: 56 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.998406:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3400/0x72f6de40e4ef453f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7ee expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.998418:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360007.998424:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360007.998659:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.999128:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360007.999149:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360007.999214:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787360007.999241:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cc9d8c9 reply state 00000000dc562b5b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360007.999251:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360007.999375:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:11616:x1874182508994688:12345-192.168.201.14@tcp:36:bash.0 Request processed in 1125us (2851us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787360007.999384:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 208 00000020:00080000:1.0:1787360007.999391:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787360008.002820:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.002840:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.002848:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.002855:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360008.002860:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.002869:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.002888:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:3.0:1787360008.002891:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360008.002898:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.002905:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3a00/0x72f6de40e4ef4569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360008.003065:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.003178:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508994816 00000100:00100000:1.0:1787360008.003191:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508994816 00000100:00100000:1.0:1787360008.003287:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 209 00000100:00100000:1.0:1787360008.003318:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+56:11616:x1874182508994816:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:1.0:1787360008.003346:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360008.003369:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce7fc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.003473:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.003490:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.003502:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360008.003532:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787360008.003536:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360008.003557:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787360008.003574:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787360008.003583:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2e00/0x72f6de40e4ef4570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.003601:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.003609:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.003612:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360008.003614:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2c00, rc 0) 00000100:00100000:1.0:1787360008.004133:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:11616:x1874182508994816:12345-192.168.201.14@tcp:101:bash.0 Request processed in 815us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.004164:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 209 00000100:00100000:0.0:1787360008.019115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.019237:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508995072 00000100:00100000:1.0:1787360008.019249:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508995072 00000100:00100000:1.0:1787360008.019325:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:1.0:1787360008.019338:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+57:11616:x1874182508995072:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:1.0:1787360008.019615:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+58:11616:x1874182508995072:12345-192.168.201.14@tcp:35:bash.0 Request processed in 278us (509us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787360008.019624:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 59 00000100:00100000:0.0:1787360008.103150:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.103257:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508995200 00000100:00100000:3.0:1787360008.103273:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508995200 00000100:00100000:3.0:1787360008.103340:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 210 00000100:00100000:3.0:1787360008.103353:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+58:11622:x1874182508995200:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360008.103403:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360008.103427:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef457e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce803 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.103500:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.103517:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.103529:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360008.103731:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787360008.103736:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787360008.103763:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.103857:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef457e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce803 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.103875:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce803 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.103884:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:3.0:1787360008.103887:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787360008.103891:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63a00, rc 0) 00000100:00100000:3.0:1787360008.104184:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508995200:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 831us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.104193:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 210 00000100:00100000:0.0:1787360008.108302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.108416:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508995328 00000100:00100000:2.0:1787360008.108429:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508995328 00000100:00100000:2.0:1787360008.108496:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 211 00000100:00100000:2.0:1787360008.108508:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508995328:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787360008.108546:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360008.108584:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef458c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce80a expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108654:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108672:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108715:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108733:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108740:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108747:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108848:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108857:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108864:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360008.108900:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787360008.108909:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360008.108930:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108943:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108952:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108960:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108968:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108974:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.108978:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.108986:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109354:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360008.109359:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360008.109365:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109372:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef4593 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109385:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109402:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109409:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109414:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.109418:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109425:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109433:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919f00) 00010000:00010000:2.0:1787360008.109436:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360008.109439:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109446:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef459a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109478:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef458c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce80a expref: 61 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109491:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce80a expref: 60 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.109498:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360008.109501:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360008.109509:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346400, rc 0) 00000100:00100000:2.0:1787360008.110008:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11622:x1874182508995328:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1489us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.110018:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 211 00000100:00100000:0.0:1787360008.114891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.115111:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508995456 00000100:00100000:1.0:1787360008.115124:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508995456 00000100:00100000:1.0:1787360008.115218:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:1.0:1787360008.115230:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:2365:x1874182508995456:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360008.115248:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360008.115276:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef45a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce80a expref: 60 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.115296:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.115302:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360008.115372:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:2365:x1874182508995456:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 135us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.115380:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:0.0:1787360008.121433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.121520:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508995712 00000100:00100000:3.0:1787360008.121533:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508995712 00000100:00100000:3.0:1787360008.121611:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 212 00000100:00100000:3.0:1787360008.121624:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508995712:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360008.121646:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360008.121706:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef45a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce811 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.121824:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.121843:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.121853:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.121899:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.121916:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 60 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.121932:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d408e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527856896:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787360008.122369:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360008.126367:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.127347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508995840 00000100:00100000:1.0:1787360008.127360:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508995840 00010000:00010000:1.0:1787360008.127672:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 61 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.129609:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:1.0:1787360008.129629:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:2363:x1874182508995840:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360008.129884:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360008.129897:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 61 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.129913:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 61 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.129939:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.129944:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.129953:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.129961:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.129984:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360008.130051:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:2363:x1874182508995840:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 432us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.130057:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 80 00010000:00010000:3.0:1787360008.135615:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2c00/0x72f6de40e4ef4577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7fc expref: 60 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.135647:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d408e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527856896:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360008.135743:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.135864:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.135872:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360008.135897:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787360008.136081:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef45a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.136099:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.136111:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360008.136114:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360008.136118:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63400, rc 0) 00000100:00100000:2.0:1787360008.136212:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11622:x1874182508995712:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 14590us (14788us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787360008.136222:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 212 00000100:00100000:2.0:1787360008.139149:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.139271:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996096 00000100:00100000:1.0:1787360008.139284:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996096 00000100:00100000:1.0:1787360008.139363:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787360008.139376:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11622:x1874182508996096:12345-192.168.201.14@tcp:103:lfs.0 00010000:00010000:1.0:1787360008.139426:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360008.139455:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef450e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7e7 expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.139478:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.139485:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360008.139558:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508996096:12345-192.168.201.14@tcp:103:lfs.0 Request processed in 184us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.139566:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787360008.142069:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.142163:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996224 00000100:00100000:2.0:1787360008.142177:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996224 00000100:00100000:2.0:1787360008.142250:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 213 00000100:00100000:2.0:1787360008.142262:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508996224:12345-192.168.201.14@tcp:58:lfs.0 00010000:00010000:2.0:1787360008.142373:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.142419:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.142433:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360008.142615:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787360008.142733:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508996224:12345-192.168.201.14@tcp:58:lfs.0 Request processed in 471us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.142742:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 213 00000100:00100000:3.0:1787360008.145149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.145288:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996352 00000100:00100000:1.0:1787360008.145300:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996352 00000100:00100000:1.0:1787360008.145358:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 214 00000100:00100000:1.0:1787360008.145369:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+59:11622:x1874182508996352:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360008.145400:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360008.145424:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce818 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.145485:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.145496:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.145517:0:5861:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.145530:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.145561:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.145564:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787360008.145569:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.145576:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3000, rc 0) 00000100:00100000:1.0:1787360008.145645:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11622:x1874182508996352:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 277us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.145653:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 214 00010000:00010000:2.0:1787360008.232547:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360008.268755:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.268801:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.268904:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.269010:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.269058:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996608 00000100:00100000:1.0:1787360008.269069:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996608 00000100:00100000:1.0:1787360008.269126:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996736 00000100:00100000:1.0:1787360008.269141:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996736 00000100:00100000:1.0:1787360008.269168:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 87 00000100:00100000:1.0:1787360008.269178:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508996608:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360008.269252:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508996608:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 75us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.269273:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 87 00000100:00100000:1.0:1787360008.269293:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 88 00000100:00100000:1.0:1787360008.269301:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508996736:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360008.269328:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2364:x1874182508996736:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.269350:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 88 00000100:00100000:2.0:1787360008.272413:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996864 00000100:00100000:2.0:1787360008.272430:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996864 00000100:00100000:2.0:1787360008.272543:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 151 00000100:00100000:2.0:1787360008.272556:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2364:x1874182508996864:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787360008.272642:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2364:x1874182508996864:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 90us (3840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.272652:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 151 00000100:00080000:3.0:1787360008.272776:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360008.277240:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996480 00000100:00100000:0.0:1787360008.277256:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996480 00000100:00100000:0.0:1787360008.277406:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 295 00000100:00100000:0.0:1787360008.277418:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182508996480:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360008.277509:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182508996480:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 93us (8605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.277517:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 295 00000040:00080000:0.0:1787360008.550906:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360008.550928:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360008.551018:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787360008.551026:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787360008.551172:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e030380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527857024:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360008.551291:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d2033fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360008.560226:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e030380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527857024:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787360008.562217:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.562359:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508996992 00000100:00100000:1.0:1787360008.562370:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508996992 00000100:00100000:1.0:1787360008.562449:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 215 00000100:00100000:1.0:1787360008.562462:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11623:x1874182508996992:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787360008.562500:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787360008.562631:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11623:x1874182508996992:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 171us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.562639:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 215 00000100:00100000:3.0:1787360008.585265:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.585458:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508997120 00000100:00100000:2.0:1787360008.585470:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508997120 00000100:00100000:2.0:1787360008.585548:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 216 00000100:00100000:2.0:1787360008.585560:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11623:x1874182508997120:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787360008.585666:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585747:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585779:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585797:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585804:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585811:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585836:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585845:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585851:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360008.585897:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787360008.585901:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360008.585914:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585925:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585932:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585949:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585956:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.585960:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585968:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.585979:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:2.0:1787360008.585982:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360008.585997:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586003:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346e00/0x72f6de40e4ef45cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586017:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586023:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586029:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586033:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.586036:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586050:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586057:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff983d25919f00) 00010000:00010000:2.0:1787360008.586059:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360008.586062:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586067:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef45d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586082:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586088:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586094:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586098:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.586100:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586104:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586111:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360008.586113:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360008.586115:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.586140:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef45d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360008.586225:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11623:x1874182508997120:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 Request processed in 668us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.586233:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 216 00000100:00100000:3.0:1787360008.588751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.588912:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508997376 00000100:00100000:1.0:1787360008.588922:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508997376 00000100:00100000:1.0:1787360008.588975:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 217 00000100:00100000:1.0:1787360008.588985:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+60:11623:x1874182508997376:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.589019:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360008.589043:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef45e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce81f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589169:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589186:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589199:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360008.589212:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787360008.589541:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589549:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589556:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589563:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360008.589567:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589575:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589590:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.589593:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787360008.589597:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589603:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589658:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef45e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce81f expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589671:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:1.0:1787360008.589673:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360008.589727:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef45e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce81f expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.589760:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3800, rc 0) 00000100:00100000:1.0:1787360008.589829:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:11623:x1874182508997376:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 845us (1098us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787360008.589838:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 217 00000100:00100000:0.0:1787360008.595222:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.595473:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508997504 00000100:00100000:2.0:1787360008.595486:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508997504 00000100:00100000:2.0:1787360008.595591:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 218 00000100:00100000:2.0:1787360008.595605:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:11623:x1874182508997504:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360008.595663:0:5863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360008.595853:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:11623:x1874182508997504:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 251us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.595861:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 218 00000100:00100000:3.0:1787360008.600110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.600748:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508997760 00000100:00100000:1.0:1787360008.600762:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508997760 00000100:00100000:1.0:1787360008.600831:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 219 00000100:00100000:1.0:1787360008.600845:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:11623:x1874182508997760:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.600872:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360008.600876:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787360008.600910:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce803 expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.600938:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360008.600944:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360008.600961:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef45f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce826 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787360008.601504:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1787360008.603838:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.603866:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.603881:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.603983:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef45f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce826 expref: 63 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.604006:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce826 expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.604016:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d20336800) 00010000:00010000:1.0:1787360008.604019:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360008.604023:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2000, rc 0) 00000100:00100000:1.0:1787360008.604116:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+62:11623:x1874182508997760:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 3274us (4020us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787360008.604136:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 219 00000100:00100000:3.0:1787360008.608032:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.608109:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508998016 00000100:00100000:1.0:1787360008.608136:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508998016 00000100:00100000:1.0:1787360008.608261:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 220 00000100:00100000:1.0:1787360008.608273:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+62:11623:x1874182508998016:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.608360:0:10018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360008.610233:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef45fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce826 expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610278:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d20336800) 00010000:00010000:1.0:1787360008.610295:0:10018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787360008.610333:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610351:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610397:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610415:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610422:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610430:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610542:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610549:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610555:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610561:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360008.610565:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610572:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610582:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360008.610585:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360008.610589:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610600:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef460a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610611:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610617:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610623:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610629:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360008.610632:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610639:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610648:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd2ef269a (ffff983d20336300) 00010000:00010000:1.0:1787360008.610650:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360008.610653:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.610658:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2800/0x72f6de40e4ef4611 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd2ef269a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.610796:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:11623:x1874182508998016:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 2520us (2769us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787360008.610804:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 220 00000100:00100000:3.0:1787360008.617234:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.621663:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527857152:0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.621802:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360008.621851:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527857664:0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.621887:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360008.621916:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360008.621923:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527857536:0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.621984:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527857280:0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.622016:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527857408:0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.622052:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527857152 00000100:00100000:0.0:1787360008.622060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527857152 00000100:00100000:0.0:1787360008.622111:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787360008.622121:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527857152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.622191:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3320:x1874182527857152:12345-0@lo:400:kworker.0 Request processed in 70us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.622199:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787360008.622240:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527857664 00000100:00100000:0.0:1787360008.622244:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527857664 00000100:00100000:0.0:1787360008.622305:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787360008.622312:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527857664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.622353:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527857664:12345-0@lo:400:kworker.0 Request processed in 42us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.622359:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787360008.622419:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787360008.623138:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360008.624944:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508998144 00000100:00100000:2.0:1787360008.624964:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508998144 00000100:00100000:2.0:1787360008.625067:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 221 00000100:00100000:2.0:1787360008.625077:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+61:11623:x1874182508998144:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360008.625101:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360008.625140:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4618 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce82d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.625182:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.625196:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.625223:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.626561:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346000/0x72f6de40e4ef4618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.626594:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 62 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.626858:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:2.0:1787360008.626862:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787360008.626866:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05347e00, rc 0) 00000100:00100000:2.0:1787360008.626961:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+62:11623:x1874182508998144:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1884us (9736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.626971:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 221 00000100:00100000:3.0:1787360008.637281:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360008.637330:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527857152:0@lo:400:kworker.0 00000100:00100000:3.0:1787360008.637343:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1787360008.637348:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1787360008.637366:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527857664:0@lo:400:kworker.0 00000100:00100000:3.0:1787360008.637393:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360008.637454:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527857408 00000100:00100000:1.0:1787360008.637469:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527857408 00000100:00100000:1.0:1787360008.637570:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527857536 00000100:00100000:1.0:1787360008.637574:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527857536 00000100:00100000:1.0:1787360008.637595:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527857280 00000100:00100000:1.0:1787360008.637598:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527857280 00000100:00100000:0.0:1787360008.637611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.637629:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508998400 00000100:00100000:1.0:1787360008.637635:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508998400 00000100:00100000:0.0:1787360008.637653:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787360008.637669:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527857408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360008.637740:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787360008.637756:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527857536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360008.637785:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527857408:12345-0@lo:400:kworker.0 Request processed in 119us (14661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.637796:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787360008.637848:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787360008.637861:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527857280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360008.637868:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527857536:12345-0@lo:400:kworker.0 Request processed in 103us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.637882:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787360008.637911:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 222 00000100:00100000:1.0:1787360008.637921:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+62:11623:x1874182508998400:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00000100:00100000:0.0:1787360008.637938:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527857280:12345-0@lo:400:kworker.0 Request processed in 80us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.637947:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787360008.637980:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527857280:0@lo:400:kworker.0 00000100:00080000:3.0:1787360008.638120:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360008.638157:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527857536:0@lo:400:kworker.0 00000100:00100000:3.0:1787360008.638183:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527857408:0@lo:400:kworker.0 00010000:00010000:1.0:1787360008.638218:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.638238:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.638252:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360008.638574:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787360008.638584:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382966906468ns, next at 383966903427ns, rc = 0 00000004:00010000:1.0:1787360008.639154:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000305bafe reply state 0000000066335ede transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.639166:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787360008.639296:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+64:11623:x1874182508998400:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 1375us (1688us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787360008.639305:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 222 00000100:00100000:2.0:1787360008.643982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:3.0:1787360008.644230:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.644249:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.644257:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.644281:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360008.644286:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.644293:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.644314:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:3.0:1787360008.644318:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360008.644323:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.644330:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3800/0x72f6de40e4ef4626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360008.644457:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508998528 00000100:00100000:0.0:1787360008.644467:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508998528 00000100:00100000:0.0:1787360008.644516:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 223 00000100:00100000:0.0:1787360008.644525:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+63:11623:x1874182508998528:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360008.644547:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360008.644564:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce834 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.644632:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 64 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.644642:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 64 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.644655:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:0.0:1787360008.644656:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360008.644658:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41800, rc 0) 00000100:00100000:0.0:1787360008.644740:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+64:11623:x1874182508998528:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 215us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.644747:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 223 00000100:00100000:3.0:1787360008.647071:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.647284:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508998656 00000100:00100000:1.0:1787360008.647297:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508998656 00000100:00100000:1.0:1787360008.647363:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:1.0:1787360008.647374:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182508998656:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787360008.647945:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a068050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182508998656:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 572us (883us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787360008.647952:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:3.0:1787360008.651547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.651781:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508998912 00000100:00100000:1.0:1787360008.651796:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508998912 00000100:00100000:1.0:1787360008.652003:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:1.0:1787360008.652015:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+64:11623:x1874182508998912:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787360008.652293:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+65:11623:x1874182508998912:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 279us (756us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787360008.652301:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 60 00000100:00100000:2.0:1787360008.656556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.656662:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508999168 00000100:00100000:3.0:1787360008.656707:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508999168 00000100:00100000:3.0:1787360008.656798:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 224 00000100:00100000:3.0:1787360008.656812:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+65:11623:x1874182508999168:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360008.656930:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a212300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+65:11623:x1874182508999168:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 120us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.656938:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 224 00000100:00100000:3.0:1787360008.662453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.662718:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508999296 00000100:00100000:0.0:1787360008.662731:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508999296 00000100:00100000:0.0:1787360008.662835:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 225 00000100:00100000:0.0:1787360008.662848:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+65:11623:x1874182508999296:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360008.662871:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360008.662897:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4634 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce83b expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.662979:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef463b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.662995:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.663009:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360008.663053:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360008.663075:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.663102:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41000/0x72f6de40e4ef4634 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce83b expref: 67 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.663122:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef463b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce83b expref: 66 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.663145:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:0.0:1787360008.663148:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360008.663152:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41a00, rc 0) 00000100:00100000:0.0:1787360008.663228:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+66:11623:x1874182508999296:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 383us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.663245:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 225 00000100:00100000:0.0:1787360008.668711:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.668759:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508999424 00000100:00100000:1.0:1787360008.668773:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508999424 00000100:00100000:1.0:1787360008.668960:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:1.0:1787360008.668972:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182508999424:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.668993:0:12078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360008.669020:0:12078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce842 expref: -99 pid: 12078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360008.669051:0:12078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f307, blocks: 0x1 00010000:00010000:1.0:1787360008.669083:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1787360008.669087:0:12078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360008.669096:0:12078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 9 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.669112:0:12078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 9 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.669141:0:12078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2800, rc 0) 00000100:00100000:1.0:1787360008.669265:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508999424:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 292us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.669273:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:2.0:1787360008.677254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.677441:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508999680 00000100:00100000:3.0:1787360008.677457:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508999680 00000100:00100000:3.0:1787360008.677527:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 226 00000100:00100000:3.0:1787360008.677553:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+66:11623:x1874182508999680:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360008.677713:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+66:11623:x1874182508999680:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 162us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.677722:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 226 00000100:00100000:3.0:1787360008.685984:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.686189:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508999808 00000100:00100000:1.0:1787360008.686203:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508999808 00000100:00100000:1.0:1787360008.686313:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:1.0:1787360008.686326:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:11623:x1874182508999808:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.686346:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360008.686367:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce849 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.686411:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.686422:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787360008.686426:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360008.686433:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.686490:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.686504:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.686520:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1874182527857792:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360008.686611:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d2012b480 going to sleep for 11 seconds 00000100:00100000:0.0:1787360008.691209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.691338:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6698:1874182527857792:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360008.691382:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.691409:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3600, rc 0) 00000100:00100000:1.0:1787360008.691478:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:11623:x1874182508999808:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 5154us (5503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.691488:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:3.0:1787360008.691587:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182508999936 00000100:00100000:3.0:1787360008.691596:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182508999936 00010000:00010000:3.0:1787360008.691638:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.691718:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:3.0:1787360008.691935:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2362:x1874182508999936:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360008.691954:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360008.691979:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.692006:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.692034:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4642 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce842 expref: 10 pid: 12078 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.692050:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360008.692054:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360008.692064:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.692089:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.692140:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 9 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.692156:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f12d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1874182527857920:192.168.201.14@tcp:105: 00000100:00100000:3.0:1787360008.692213:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d05c7ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360008.702707:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f12d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1874182527857920:192.168.201.14@tcp:105: 00010000:00010000:3.0:1787360008.702746:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360008.702801:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182508999936:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 11071us (11604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.702812:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:0.0:1787360008.707075:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.707239:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509000064 00000100:00100000:3.0:1787360008.707253:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509000064 00002000:00100000:3.0:1787360008.707311:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff983d3f8e2a00 x1874182509000064/t0(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:199/0 lens 504/0 e 0 to 0 dl 1787360019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360008.707323:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8e2a00 with x1874182509000064 ext(0->12) 00002000:00010000:3.0:1787360008.707329:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f8e2a00 00000100:00100000:3.0:1787360008.707367:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:3.0:1787360008.707387:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2363:x1874182509000064:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787360008.708227:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182509000064:12345-192.168.201.14@tcp:4:lhsmtool_posix.0 Request processed in 846us (1159us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787360008.708248:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00002000:00100000:3.0:1787360008.708259:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff983d3f8e2a00 x1874182509000064/t4294967321(0) o4->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:199/0 lens 504/448 e 0 to 0 dl 1787360019 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787360008.708269:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8e2a00 with x1874182509000064 ext(0->12) 00002000:00010000:3.0:1787360008.708274:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f8e2a00 00000100:00100000:0.0:1787360008.711489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.711655:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509000192 00000100:00100000:2.0:1787360008.711667:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509000192 00000100:00100000:2.0:1787360008.711943:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 227 00000100:00100000:2.0:1787360008.711956:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+66:11623:x1874182509000192:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787360008.748064:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+66:11623:x1874182509000192:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 Request processed in 36096us (36571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.748079:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 227 00000001:00080000:3.0:1787360008.749061:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000004:00080000:3.0:1787360008.749081:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787360008.749119:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d05c7fcc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787360008.749134:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1044ec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d07f179c0 00000020:00080000:3.0:1787360008.749138:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d1044e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d20070800 00000001:00080000:3.0:1787360008.749172:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787360008.749177:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787360008.749206:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787360008.749221:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d12e44540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787360008.749224:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d3f5d5000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d12e44840 00000020:00080000:3.0:1787360008.749228:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d3f5d5500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d3f126800 00000020:00080000:1.0:1787360008.749325:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787360008.749573:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787360008.749715:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360008.749735:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527858048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787360008.749817:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360008.749863:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527858048 00000100:00100000:1.0:1787360008.749873:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527858048 00000100:00100000:1.0:1787360008.749936:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787360008.749946:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527858048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787360008.749980:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787360008.750020:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a88f306, atime: 0x6a88f306, ctime: 0x6a88f306, blocks: 0x1 00010000:00010000:1.0:1787360008.750031:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750051:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787360008.750056:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360008.750064:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750082:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750093:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750102:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750120:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787360008.750593:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1874182527858048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 646us (774us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787360008.750611:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1787360008.750643:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360008.750650:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750659:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360008.750664:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750698:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750719:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750727:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0496527/0x72f6de40e4ef4650 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.750751:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360008.750752:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360008.750754:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360008.750762:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360008.750800:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787360008.750806:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787360008.750830:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f98d500, transno 4294967307 00000100:00100000:1.0:1787360008.750849:0:3318:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff983d3a213480 x1874182527856768/t4294967309(4294967309) o1000->lustre-OST0000-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1787360023 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_000.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787360008.750874:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d27f1d880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787360008.750879:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527858048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787360008.751817:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527858304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787360008.751876:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360008.751923:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527858304 00000100:00100000:0.0:1787360008.751931:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527858304 00000100:00100000:0.0:1787360008.751974:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787360008.751984:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527858304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787360008.752116:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787360008.752120:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787360008 00002000:00010000:0.0:1787360008.752132:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787360008.752134:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787360007 -> 1787360008 00002000:00010000:0.0:1787360008.752137:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787360008.752176:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1874182527858304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (299us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787360008.752185:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:0.0:1787360008.752218:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f8cea00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787360008.752224:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527858304:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787360008.752302:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360008.752313:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527858176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787360008.752343:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360008.753517:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527858176 00000100:00100000:0.0:1787360008.753532:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527858176 00000100:00100000:0.0:1787360008.753659:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787360008.753670:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874182527858176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787360008.753748:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1787360008.753774:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.753801:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.753812:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787360008.753816:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360008.753821:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.753867:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.753884:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 10 pid: 6701 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360008.753899:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1874182527858432:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360008.753988:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d2033f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360008.757033:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.757183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.757604:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a20e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1874182527858432:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360008.757637:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.757882:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509000320 00000100:00100000:1.0:1787360008.757891:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509000320 00000100:00100000:1.0:1787360008.757950:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:1.0:1787360008.757961:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182509000320:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787360008.758135:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509000448 00000100:00100000:1.0:1787360008.758140:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509000448 00010000:00010000:1.0:1787360008.758163:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 12 pid: 6701 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.760338:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 82 00000100:00100000:1.0:1787360008.760362:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+12:2363:x1874182509000448:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360008.760396:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360008.760408:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 12 pid: 6701 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.760427:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 12 pid: 6701 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.760452:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef4412 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce7a8 expref: 12 pid: 6701 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.760469:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360008.760485:0:8457:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360008.760493:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.760504:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.760542:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360008.760628:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+11:2363:x1874182509000448:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 275us (3443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.760636:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 82 00010000:00010000:0.0:1787360008.761938:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.761955:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.761975:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.761984:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.762018:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360008.763109:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360008.763131:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.763144:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360008.763157:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.763167:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.763193:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.763201:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.763221:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360008.763223:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360008.763225:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360008.763810:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527858176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10137us (11460us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787360008.763822:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:1.0:1787360008.763891:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d3f8cce00/2, rc 0, transno 4294967323 00000100:00100000:1.0:1787360008.763898:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527858176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787360008.796470:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+10:2363:x1874182509000320:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 Request processed in 38498us (39434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.796485:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 70 00000100:00100000:1.0:1787360008.799192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000001:00080000:0.0:1787360008.799299:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787360008.799315:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1787360008.799321:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1787360008.799399:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509000704 00000100:00100000:3.0:1787360008.799413:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509000704 00000100:00100000:3.0:1787360008.799524:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 228 00000100:00100000:3.0:1787360008.799537:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11623:x1874182509000704:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360008.799607:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360008.799642:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef463b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce83b expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.799661:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:3.0:1787360008.799718:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787360008.799752:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.799766:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.799777:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360008.800317:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d56fad0 reply state 0000000006c97fb4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.800329:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360008.800532:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:11623:x1874182509000704:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 995us (1348us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787360008.800541:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 228 00000100:00100000:1.0:1787360008.804282:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.804384:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509000832 00000100:00100000:2.0:1787360008.804462:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509000832 00000100:00100000:2.0:1787360008.804584:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 71 00000100:00100000:2.0:1787360008.804597:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182509000832:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787360008.804836:0:12078:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787360008.804840:0:12078:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787360008 -> 1787360007 00002000:00010000:2.0:1787360008.804843:0:12078:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787360006 00002000:00010000:2.0:1787360008.804845:0:12078:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787360008 -> 1787360007 00002000:00010000:2.0:1787360008.804848:0:12078:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787360008.804919:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182509000832:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 323us (646us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787360008.804928:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 71 00010000:00010000:3.0:1787360008.806903:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.806920:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.806927:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.806935:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360008.806939:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.806948:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.806999:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:3.0:1787360008.807003:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360008.807009:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.807015:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62800/0x72f6de40e4ef465e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360008.807439:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.807568:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509001088 00000100:00100000:1.0:1787360008.807579:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509001088 00000100:00100000:1.0:1787360008.807640:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 229 00000100:00100000:1.0:1787360008.807651:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:11623:x1874182509001088:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.807748:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.807763:0:10018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.807786:0:10018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.807828:0:10018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.807843:0:10018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 20 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.807858:0:10018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527858560:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360008.807945:0:10018:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0576a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360008.810726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.810820:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509001216 00000100:00100000:1.0:1787360008.810833:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509001216 00010000:00010000:1.0:1787360008.810885:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 21 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.810932:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 83 00000100:00100000:1.0:1787360008.810943:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2363:x1874182509001216:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360008.810959:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360008.810967:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 21 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.810983:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 21 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811019:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:1.0:1787360008.811035:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811043:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811049:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811066:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360008.811110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2363:x1874182509001216:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 170us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.811115:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 83 00010000:00010000:1.0:1787360008.811185:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347e00/0x72f6de40e4ef461f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce82d expref: 20 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.811202:0:10018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10018:1874182527858560:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360008.811226:0:10018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811236:0:10018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811243:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811272:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811280:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811298:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.811305:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360008.811310:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.813074:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.813097:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:1.0:1787360008.813099:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787360008.813105:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.813110:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.813231:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11623:x1874182509001088:12345-192.168.201.14@tcp:55:lhsmtool_posix.0 Request processed in 5577us (5790us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787360008.813242:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 229 00000100:00100000:3.0:1787360008.817852:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.817959:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509001344 00000100:00100000:1.0:1787360008.817973:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509001344 00000100:00100000:1.0:1787360008.818037:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 72 00000100:00100000:1.0:1787360008.818050:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182509001344:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.818106:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.818173:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.818200:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360008.818205:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787360008.818210:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.818258:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.818273:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 8 pid: 6698 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.818288:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1874182527858688:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360008.818389:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0576a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360008.822333:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.822469:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509001472 00000100:00100000:3.0:1787360008.822482:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509001472 00010000:00010000:3.0:1787360008.822536:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 9 pid: 6698 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.822594:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:3.0:1787360008.822608:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182509001472:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360008.822626:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360008.822652:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 9 pid: 6698 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.822668:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 9 pid: 6698 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.822884:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360008.822890:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787360008.822898:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.822925:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.823019:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360008.823084:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+9:2362:x1874182509001472:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 477us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.823094:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 84 00010000:00010000:1.0:1787360008.823716:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4649 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce849 expref: 8 pid: 6698 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.823734:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6701:1874182527858688:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360008.823759:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823771:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823779:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823821:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823830:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823838:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823846:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360008.823851:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823859:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823873:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.823879:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020fca217/0x72f6de40e4ef466c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.823942:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182509001344:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 Request processed in 5895us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360008.823951:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 72 00000100:00100000:2.0:1787360008.827398:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360008.827497:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509001728 00000100:00100000:1.0:1787360008.827512:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509001728 00000100:00100000:1.0:1787360008.827585:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 230 00000100:00100000:1.0:1787360008.827596:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11623:x1874182509001728:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787360008.827724:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.827745:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.827757:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.827971:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.827996:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.828006:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.828045:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.828061:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 20 pid: 5861 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.828077:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527858816:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360008.828172:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0576a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360008.831738:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.831823:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509001856 00000100:00100000:3.0:1787360008.831835:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509001856 00010000:00010000:3.0:1787360008.831882:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 21 pid: 5861 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360008.831916:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:3.0:1787360008.831928:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2362:x1874182509001856:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360008.831945:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360008.831952:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 21 pid: 5861 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.831968:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 21 pid: 5861 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.832005:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:3.0:1787360008.832011:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.832021:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.832029:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.832067:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360008.832134:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2362:x1874182509001856:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 208us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.832142:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 85 00010000:00010000:1.0:1787360008.832362:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef462d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce834 expref: 20 pid: 5861 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.832379:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527858816:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360008.832403:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.832414:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.832420:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360008.832610:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787360008.832806:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787360008.832851:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787360008.832937:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1874182527858944:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360008.833008:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360008.833044:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12f2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787360008.833221:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527858944 00000100:00100000:3.0:1787360008.833228:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527858944 00000100:00100000:3.0:1787360008.833275:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787360008.833284:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5863:x1874182527858944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787360008.833355:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5863:x1874182527858944:12345-0@lo:1000:mdt00_002.0 Request processed in 73us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.833363:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360008.834270:0:5863:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1787360008.834279:0:5863:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f8cea00, transno 4294967322 00000100:00100000:1.0:1787360008.834337:0:5863:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff983d3f8cce00 x1874182527858176/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787360024 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360008.834350:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1874182527858944:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787360008.834933:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787360008.835671:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1874182527859072:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787360008.835774:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360008.835815:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0576a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787360008.836054:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527859072 00000100:00100000:3.0:1787360008.836064:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527859072 00000100:00100000:3.0:1787360008.836140:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360008.836152:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5863:x1874182527859072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787360008.836377:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5863:x1874182527859072:12345-0@lo:1000:mdt00_002.0 Request processed in 226us (601us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787360008.836400:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360008.836617:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1874182527859072:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787360008.836659:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836669:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836719:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836725:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.836729:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836737:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836754:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d25919f00) 00010000:00010000:2.0:1787360008.836758:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360008.836764:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836770:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2000/0x72f6de40e4ef467a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836804:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836810:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836816:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836821:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360008.836824:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836841:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836850:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360008.836852:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360008.836860:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836870:0:5863:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836881:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.836912:0:5863:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360008.836925:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a210e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527859200:192.168.201.14@tcp:105: 00000100:00100000:2.0:1787360008.837008:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360008.841060:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a210e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1874182527859200:192.168.201.14@tcp:105: 00010000:00010000:1.0:1787360008.841096:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841108:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef45bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841154:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841170:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841183:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841194:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841201:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841207:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841214:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360008.841218:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841227:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841242:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.841259:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360008.841263:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841269:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef4681 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841283:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841289:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841296:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841301:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360008.841304:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841311:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841319:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360008.841321:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360008.841324:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360008.841330:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef4673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360008.841564:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:11623:x1874182509001728:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 13968us (14187us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787360008.841583:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 230 00000020:00080000:1.0:1787360008.841590:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787360008.842403:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787360008.842409:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787360008.843283:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787360008.843295:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360008.845270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.845371:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509002112 00000100:00100000:0.0:1787360008.845441:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509002112 00000100:00100000:0.0:1787360008.845551:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 61 00000100:00100000:0.0:1787360008.845571:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+23:11623:x1874182509002112:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787360008.846293:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787360008.846419:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787360008.846484:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.846503:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.846530:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.846541:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.846548:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.846554:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360008.846582:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787360008.846715:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11623:x1874182509002112:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 1150us (1452us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787360008.846725:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 61 00000020:00080000:0.0:1787360008.846731:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787360008.846812:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360008.846821:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.846828:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360008.846833:0:6714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.846841:0:6714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.846865:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff983d09750b00) 00010000:00010000:2.0:1787360008.846868:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787360008.846874:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.846879:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4688 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.846895:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360008.846896:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360008.846898:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360008.849651:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.850891:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509002240 00000100:00100000:0.0:1787360008.850908:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509002240 00000100:00100000:0.0:1787360008.850968:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:0.0:1787360008.850979:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1056a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11622:x1874182509002240:12345-192.168.201.14@tcp:49:lfs.0 00000100:00100000:0.0:1787360008.851863:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1056a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11622:x1874182509002240:12345-192.168.201.14@tcp:49:lfs.0 Request processed in 400us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.851874:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 62 00000100:00100000:2.0:1787360008.855362:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.855471:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509002496 00000100:00100000:0.0:1787360008.855484:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509002496 00000100:00100000:0.0:1787360008.855554:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 231 00000100:00100000:0.0:1787360008.855565:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11622:x1874182509002496:12345-192.168.201.14@tcp:58:lfs.0 00000040:00080000:0.0:1787360008.855877:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787360008.855976:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11622:x1874182509002496:12345-192.168.201.14@tcp:58:lfs.0 Request processed in 411us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360008.855994:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 231 00000100:00100000:3.0:1787360008.912264:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360008.912413:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509002624 00000100:00100000:2.0:1787360008.912426:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509002624 00000100:00100000:2.0:1787360008.912504:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 232 00000100:00100000:2.0:1787360008.912518:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+25:11625:x1874182509002624:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787360008.912541:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360008.912585:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef468f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce850 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.912666:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.912726:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.912740:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.912779:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.912787:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.912795:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.913097:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.913109:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.913256:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.913299:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.913315:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 26 pid: 5862 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360008.913330:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527859328:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360008.913424:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360008.925008:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360008.925115:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1874182527859328:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360008.925180:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360008.925263:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509002880 00000100:00100000:0.0:1787360008.925273:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509002880 00000100:00100000:0.0:1787360008.925338:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:0.0:1787360008.925348:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:5601:x1874182509002880:12345-192.168.201.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787360008.925630:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:5601:x1874182509002880:12345-192.168.201.14@tcp:35:ldlm_bl.0 Request processed in 282us (631us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787360008.925638:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 63 00000100:00100000:3.0:1787360008.935091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360008.935396:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509003008 00000100:00100000:0.0:1787360008.935771:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509003008 00010000:00010000:2.0:1787360008.935885:0:8457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 28 pid: 5862 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360008.936000:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 86 00000100:00100000:2.0:1787360008.936012:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:2365:x1874182509003008:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360008.936031:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360008.936039:0:8457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 28 pid: 5862 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.936054:0:8457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 28 pid: 5862 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.936078:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63400/0x72f6de40e4ef45af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce811 expref: 28 pid: 5862 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.936095:0:8457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360008.936100:0:8457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.936110:0:8457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.936127:0:8457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360008.936158:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360008.936224:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+27:2365:x1874182509003008:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 213us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360008.936232:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 86 00010000:00010000:3.0:1787360008.936296:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936312:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360008.936360:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787360008.936365:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787360008.936398:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936411:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936420:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936440:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936447:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936453:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360008.936457:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936463:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936472:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:3.0:1787360008.936474:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360008.936478:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936492:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346600/0x72f6de40e4ef4696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936504:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936510:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936514:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936519:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360008.936522:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936526:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936534:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff983d25919f00) 00010000:00010000:3.0:1787360008.936536:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360008.936539:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936544:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347400/0x72f6de40e4ef469d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936587:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346a00/0x72f6de40e4ef468f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce850 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936603:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce850 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360008.936616:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:3.0:1787360008.936619:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360008.936622:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346800, rc 0) 00000100:00100000:3.0:1787360008.936649:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11625:x1874182509002624:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 24134us (24397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360008.936656:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 232 00000100:00100000:1.0:1787360009.126920:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360009.126948:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527859456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360009.127041:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360009.127202:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527859456 00000100:00100000:2.0:1787360009.127222:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527859456 00000100:00100000:2.0:1787360009.127293:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787360009.127304:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874182527859456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360009.127332:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787360009.127392:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1874182527859456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360009.127400:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787360009.127466:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527859456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787360009.254856:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360009.870421:0:12622:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360009.870431:0:12622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360009.870481:0:12622:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787360009.870487:0:12622:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787360009.909486:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360009.909496:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360009.909538:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787360009.909545:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787360009.909742:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527859584:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787360009.909840:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0576a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787360009.916044:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11690:1874182527859584:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787360009.919822:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360009.919928:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509003136 00000100:00100000:2.0:1787360009.919943:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509003136 00000100:00100000:2.0:1787360009.920013:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 233 00000100:00100000:2.0:1787360009.920025:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d408e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11638:x1874182509003136:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360009.920067:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360009.920187:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d408e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11638:x1874182509003136:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 163us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360009.920213:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 233 00000100:00100000:3.0:1787360009.924270:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360009.924420:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509003392 00000100:00100000:1.0:1787360009.924436:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509003392 00000100:00100000:1.0:1787360009.924515:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 234 00000100:00100000:1.0:1787360009.924529:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+26:11638:x1874182509003392:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360009.924556:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360009.924596:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce857 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.924732:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.924749:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.924764:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360009.924775:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787360009.925058:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce857 expref: 29 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.925793:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce857 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.925823:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360009.925827:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360009.925832:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3600, rc 0) 00000100:00100000:1.0:1787360009.925930:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11638:x1874182509003392:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1403us (1671us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787360009.925938:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 234 00000100:00100000:0.0:1787360009.938477:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360009.938582:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360009.938810:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509003648 00000100:00100000:1.0:1787360009.938824:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509003648 00000100:00100000:3.0:1787360009.938979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509003776 00000100:00100000:3.0:1787360009.938985:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509003776 00000100:00100000:1.0:1787360009.939003:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 235 00000100:00100000:1.0:1787360009.939018:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:11638:x1874182509003648:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360009.939036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:3.0:1787360009.939045:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:2365:x1874182509003776:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360009.939059:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360009.939116:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360009.939171:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce857 expref: 29 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.939235:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.939248:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.939526:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.939535:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.939542:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.940473:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360009.940484:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.940495:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.940512:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:1.0:1787360009.940515:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787360009.940521:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360009.940527:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2600/0x72f6de40e4ef46c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360009.941154:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:11638:x1874182509003648:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 2131us (2680us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787360009.941164:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 235 00010000:00010000:3.0:1787360009.942282:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:3.0:1787360009.942294:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360009.942360:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:2365:x1874182509003776:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 3311us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360009.942373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00000040:00080000:1.0:1787360009.942814:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360009.942819:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360009.943862:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787360009.943880:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360009.945671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360009.946223:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004032 00000100:00100000:0.0:1787360009.946237:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004032 00000100:00100000:0.0:1787360009.946303:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 64 00000100:00100000:0.0:1787360009.946317:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+28:11638:x1874182509004032:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787360009.946594:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:11638:x1874182509004032:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 279us (931us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787360009.946603:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 64 00010000:00010000:3.0:1787360010.279420:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360011.175935:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360011.175964:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527859712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787360011.176054:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360011.176148:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527859712 00000100:00100000:1.0:1787360011.176160:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527859712 00000100:00100000:1.0:1787360011.176228:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787360011.176239:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874182527859712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787360011.176372:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787360011.176549:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787360011.176616:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1874182527859712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 376us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360011.176625:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787360011.177547:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527859712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787360011.302961:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360011.801908:0:12675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787360011.801919:0:12675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787360011.802031:0:12675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787360011.802044:0:12675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787360011.989745:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360011.989861:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004288 00000100:00100000:2.0:1787360011.989873:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004288 00000100:00080000:0.0:1787360011.989976:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360011.990276:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 236 00000100:00100000:2.0:1787360011.990291:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+29:11658:x1874182509004288:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787360011.990320:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360011.990349:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef46c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce85e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360011.990449:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef46ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360011.990462:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef46ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360011.990473:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef46ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360011.990481:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787360011.990582:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347200/0x72f6de40e4ef46c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce85e expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360011.990593:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef46ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce85e expref: 31 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360011.990600:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360011.990603:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787360011.990605:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346400, rc 0) 00000100:00100000:2.0:1787360011.990661:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11658:x1874182509004288:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 375us (928us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787360011.990667:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 236 00000100:00100000:3.0:1787360011.993608:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360011.993760:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004416 00000100:00100000:0.0:1787360011.993772:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004416 00000100:00100000:0.0:1787360011.993874:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 237 00000100:00100000:0.0:1787360011.993886:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11658:x1874182509004416:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:0.0:1787360011.993963:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.993983:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.993996:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994024:0:10018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994032:0:10018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994039:0:10018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994045:0:10018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360011.994051:0:10018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994085:0:10018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994101:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:0.0:1787360011.994104:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360011.994109:0:10018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360011.994115:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef46dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360011.994201:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:11658:x1874182509004416:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 316us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360011.994209:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 237 00000100:00100000:3.0:1787360012.060650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360012.060789:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004544 00000100:00100000:0.0:1787360012.060864:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004544 00000100:00080000:1.0:1787360012.060973:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360012.061008:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 73 00000100:00100000:0.0:1787360012.061020:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2362:x1874182509004544:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:0.0:1787360012.061040:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360012.061064:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef46e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce865 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787360012.061104:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a88f307, atime: 0x6a88f306, ctime: 0x6a88f307, blocks: 0xb 00010000:00010000:0.0:1787360012.061194:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1787360012.061200:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360012.061211:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef46e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce865 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360012.061248:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef46e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce865 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360012.061265:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:0.0:1787360012.062563:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182509004544:12345-192.168.201.14@tcp:101:cat.0 Request processed in 1539us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360012.062576:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 73 00000100:00100000:3.0:1787360012.068490:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360012.068918:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004672 00000100:00100000:1.0:1787360012.068932:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004672 00002000:00100000:1.0:1787360012.068983:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff983d3f8e0700 x1874182509004672/t0(0) o3->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:203/0 lens 488/0 e 0 to 0 dl 1787360023 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360012.069006:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8e0700 with x1874182509004672 ext(0->4095) 00002000:00010000:1.0:1787360012.069013:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f8e0700 00000100:00100000:1.0:1787360012.069049:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787360012.069060:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182509004672:12345-192.168.201.14@tcp:3:cat.0 00000100:00100000:1.0:1787360012.069282:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2363:x1874182509004672:12345-192.168.201.14@tcp:3:cat.0 Request processed in 222us (801us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787360012.069291:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00002000:00100000:1.0:1787360012.069298:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff983d3f8e0700 x1874182509004672/t0(0) o3->2b5a77f8-dccb-4cf2-aff0-2d737bdb5430@192.168.201.14@tcp:203/0 lens 488/4536 e 0 to 0 dl 1787360023 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787360012.069307:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff983d3f8e0700 with x1874182509004672 ext(0->4095) 00002000:00010000:1.0:1787360012.069310:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff983d3f8e0700 00010000:00010000:1.0:1787360012.326857:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787360012.780621:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787360012.780639:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787360012.780645:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1787360013.352225:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360013.389477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360013.389519:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360013.389554:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360013.389573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360013.389592:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360013.389779:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004800 00000100:00100000:1.0:1787360013.389792:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004800 00000100:00100000:1.0:1787360013.389854:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 297 00000100:00100000:1.0:1787360013.389867:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182509004800:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360013.389958:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+13:2362:x1874182509004800:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 92us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.389966:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 297 00000100:00100000:1.0:1787360013.390018:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005312 00000100:00100000:1.0:1787360013.390022:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005312 00000100:00100000:1.0:1787360013.390179:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509004928 00000100:00100000:1.0:1787360013.390183:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509004928 00000100:00100000:1.0:1787360013.390208:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 155 00000100:00100000:1.0:1787360013.390215:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182509005312:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360013.390249:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+5:2362:x1874182509005312:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.390256:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 155 00000100:00100000:1.0:1787360013.390269:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 156 00000100:00100000:1.0:1787360013.390276:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:2362:x1874182509004928:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360013.390299:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+31:2362:x1874182509004928:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 24us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.390305:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 156 00000100:00100000:1.0:1787360013.390324:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005056 00000100:00100000:1.0:1787360013.390327:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005056 00000100:00100000:1.0:1787360013.390353:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005184 00000100:00100000:1.0:1787360013.390356:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005184 00000100:00100000:1.0:1787360013.390375:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 90 00000100:00100000:1.0:1787360013.390382:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2362:x1874182509005056:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360013.390407:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a20d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2362:x1874182509005056:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 26us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.390413:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 90 00000100:00100000:1.0:1787360013.390425:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 91 00000100:00100000:1.0:1787360013.390430:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182509005184:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360013.390452:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+8:2362:x1874182509005184:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 23us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.390466:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 91 00000100:00080000:1.0:1787360013.390587:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360013.390592:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360013.734997:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360013.735023:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527859840:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735112:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360013.735183:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527859840 00000100:00100000:3.0:1787360013.735192:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527859840 00000100:00100000:3.0:1787360013.735241:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787360013.735252:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3317:x1874182527859840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735312:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3317:x1874182527859840:12345-0@lo:400:kworker.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360013.735319:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787360013.735371:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527859840:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735417:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360013.735425:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527859968:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735452:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360013.735491:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527860096:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735513:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360013.735565:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527860224:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735591:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360013.735626:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360013.735632:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527860352:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735654:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360013.735717:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787360013.735724:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527860480:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.735747:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360013.735967:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527859968 00000100:00100000:1.0:1787360013.735973:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527859968 00000100:00100000:1.0:1787360013.736014:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860096 00000100:00100000:1.0:1787360013.736016:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860096 00000100:00100000:1.0:1787360013.736049:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860352 00000100:00100000:1.0:1787360013.736053:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860352 00000100:00100000:1.0:1787360013.736070:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787360013.736077:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527859968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736122:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527859968:12345-0@lo:400:kworker.0 Request processed in 45us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.736128:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787360013.736141:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787360013.736148:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527860096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736175:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527860096:12345-0@lo:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.736180:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787360013.736192:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787360013.736197:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874182527860352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736225:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874182527860352:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.736231:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787360013.736251:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860224 00000100:00100000:1.0:1787360013.736254:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860224 00000100:00100000:1.0:1787360013.736278:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860480 00000100:00100000:1.0:1787360013.736288:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860480 00000100:00100000:1.0:1787360013.736314:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787360013.736321:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527860224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736351:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527860224:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.736357:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787360013.736368:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787360013.736374:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527860480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736399:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527860480:12345-0@lo:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360013.736404:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1787360013.736427:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360013.736431:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787360013.736434:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360013.736462:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527860480:0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736473:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527860096:0@lo:400:kworker.0 00000100:00100000:1.0:1787360013.736483:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527859968:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.736636:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527860352:0@lo:400:kworker.0 00000100:00100000:3.0:1787360013.736646:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787360013.736651:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787360013.736668:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d27f1d880, transno 4294967310 00000100:00100000:3.0:1787360013.736710:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e3f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527860224:0@lo:400:kworker.0 00000001:00080000:3.0:1787360013.821655:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1787360013.832825:0:5884:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff983d2033f240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787360013.832838:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d11099400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff983d2033f0c0 00000020:00080000:3.0:1787360013.832840:0:5884:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff983d11099c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff983d3f126000 00000020:00080000:3.0:1787360013.832880:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787360013.832917:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787360013.833159:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1787360013.834342:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:3.0:1787360014.246890:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527860608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360014.246979:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360014.249101:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860608 00000100:00100000:2.0:1787360014.249119:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860608 00000100:00100000:2.0:1787360014.249196:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787360014.249208:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527860608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360014.249252:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360014.249345:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1874182527860608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360014.249353:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787360014.249414:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527860608:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787360014.328098:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1787360014.328121:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787360014.328128:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:0.0:1787360014.375087:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360015.399641:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360016.296178:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360016.296205:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527860736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360016.296293:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360016.296371:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860736 00000100:00100000:2.0:1787360016.296381:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860736 00000100:00100000:2.0:1787360016.296460:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787360016.296472:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527860736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360016.296518:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360016.296570:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527860736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360016.296578:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787360016.296605:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360016.296644:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527860736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787360016.429396:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360016.860015:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360016.860187:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005440 00000100:00100000:1.0:1787360016.860200:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005440 00000100:00100000:1.0:1787360016.860287:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 238 00000100:00100000:1.0:1787360016.860298:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11303:x1874182509005440:12345-192.168.201.14@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787360016.860412:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11303:x1874182509005440:12345-192.168.201.14@tcp:60:lhsmtool_posix.0 Request processed in 116us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360016.860429:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 238 00000100:00080000:2.0:1787360016.860567:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360016.868704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360016.869195:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005696 00000100:00100000:2.0:1787360016.869210:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005696 00000100:00100000:2.0:1787360016.869286:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:2.0:1787360016.869298:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:11303:x1874182509005696:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787360016.870236:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:11303:x1874182509005696:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 934us (1565us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787360016.870247:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 65 00000100:00100000:0.0:1787360017.093305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360017.093437:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005824 00000100:00100000:1.0:1787360017.093451:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005824 00000100:00100000:1.0:1787360017.093528:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 239 00000100:00100000:1.0:1787360017.093540:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:12109:x1874182509005824:12345-192.168.201.14@tcp:101:lsof.0 00010000:00010000:1.0:1787360017.093562:0:10018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360017.093585:0:10018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce86c expref: -99 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360017.093663:0:10018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef46f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360017.093709:0:10018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef46f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360017.093724:0:10018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef46f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360017.093940:0:10018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787360017.093945:0:10018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360017.094034:0:10018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef46f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360017.094061:0:10018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3600/0x72f6de40e4ef46ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce86c expref: 7 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360017.094187:0:10018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef46f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce86c expref: 6 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360017.094209:0:10018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:1.0:1787360017.094213:0:10018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787360017.094217:0:10018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2400, rc 0) 00000100:00100000:1.0:1787360017.094343:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+6:12109:x1874182509005824:12345-192.168.201.14@tcp:101:lsof.0 Request processed in 805us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360017.094350:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 239 00000100:00080000:2.0:1787360017.094712:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787360017.127040:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787360017.127051:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360017.127741:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787360017.127749:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787360017.446909:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360018.471381:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360018.506777:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360018.506846:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360018.506892:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360018.506925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360018.506972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360018.507007:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006464 00000100:00100000:3.0:1787360018.507020:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006464 00000100:00100000:1.0:1787360018.507020:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006208 00000100:00100000:1.0:1787360018.507027:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006208 00000100:00100000:1.0:1787360018.507096:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006336 00000100:00100000:1.0:1787360018.507099:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006336 00000100:00100000:1.0:1787360018.507126:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:1.0:1787360018.507137:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182509006208:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360018.507201:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509005952 00000100:00100000:0.0:1787360018.507206:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509005952 00000100:00100000:1.0:1787360018.507227:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2363:x1874182509006208:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 90us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360018.507237:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:0.0:1787360018.507243:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 299 00000100:00100000:0.0:1787360018.507253:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182509005952:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360018.507262:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00100000:1.0:1787360018.507272:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182509006336:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360018.507287:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03658e77-9945-4faf-b424-380f2de8cb18+13:2363:x1874182509005952:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 35us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360018.507294:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 299 00000100:00100000:1.0:1787360018.507311:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2363:x1874182509006336:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 40us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360018.507320:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00080000:1.0:1787360018.507354:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360018.507369:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360018.507593:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006080 00000100:00100000:3.0:1787360018.507597:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006080 00000100:00080000:0.0:1787360018.507663:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360018.507752:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 160 00000100:00100000:3.0:1787360018.507759:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:2363:x1874182509006464:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360018.507797:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e3f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:656feb27-2023-42fb-9cb9-36f15421ff39+6:2363:x1874182509006464:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 39us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.507805:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 160 00000100:00100000:3.0:1787360018.507819:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 161 00000100:00100000:3.0:1787360018.507825:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:2363:x1874182509006080:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360018.507849:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:2363:x1874182509006080:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 25us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.507853:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 161 00000100:00100000:3.0:1787360018.856038:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527860864:0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.856147:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360018.856207:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527861376:0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.856236:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360018.856265:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360018.856270:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527861248:0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.856297:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360018.856332:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860864 00000100:00100000:3.0:1787360018.856358:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860864 00000100:00100000:3.0:1787360018.856409:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787360018.856419:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527860864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.856477:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d12e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527860864:12345-0@lo:400:kworker.0 Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.856484:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787360018.856539:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527860864:0@lo:400:kworker.0 00000100:00100000:2.0:1787360018.856739:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527861120:0@lo:400:kworker.0 00000100:00100000:2.0:1787360018.857015:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360018.857063:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787360018.857071:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527860992:0@lo:400:kworker.0 00000100:00100000:2.0:1787360018.857097:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360018.857114:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527861504:0@lo:400:kworker.0 00000100:00100000:2.0:1787360018.857138:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360018.858134:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861376 00000100:00100000:3.0:1787360018.858145:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861376 00000100:00100000:3.0:1787360018.858205:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861120 00000100:00100000:3.0:1787360018.858209:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861120 00000100:00100000:3.0:1787360018.858223:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527860992 00000100:00100000:3.0:1787360018.858226:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527860992 00000100:00100000:3.0:1787360018.858242:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787360018.858250:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527861376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.858331:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527861376:12345-0@lo:400:kworker.0 Request processed in 81us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.858338:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787360018.858355:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787360018.858361:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527861120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.858395:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527861120:12345-0@lo:400:kworker.0 Request processed in 34us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.858401:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787360018.858414:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787360018.858420:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527860992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360018.858448:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527860992:12345-0@lo:400:kworker.0 Request processed in 29us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360018.858468:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1787360018.858488:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360018.858530:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f195500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527861376:0@lo:400:kworker.0 00000100:00100000:1.0:1787360018.859003:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861248 00000100:00100000:1.0:1787360018.859010:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861248 00000100:00100000:1.0:1787360018.859071:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861504 00000100:00100000:1.0:1787360018.859075:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861504 00000100:00100000:1.0:1787360018.859098:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360018.859107:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527861248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360018.859164:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527861248:12345-0@lo:400:kworker.0 Request processed in 59us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360018.859171:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787360018.859185:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787360018.859192:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527861504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360018.859224:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527861504:12345-0@lo:400:kworker.0 Request processed in 33us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360018.859230:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787360018.859252:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787360018.859255:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360018.859281:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527861248:0@lo:400:kworker.0 00000100:00100000:1.0:1787360018.863416:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527860992:0@lo:400:kworker.0 00000100:00100000:1.0:1787360018.863438:0:3320:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1787360018.863444:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d3f8cce00, transno 4294967323 00000004:00080000:1.0:1787360018.863460:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1787360018.863483:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f194700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527861504:0@lo:400:kworker.0 00000100:00100000:1.0:1787360018.863500:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a211c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527861120:0@lo:400:kworker.0 00000001:00080000:0.0:1787360018.909596:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787360018.909613:0:5884:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787360018.909671:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787360018.909713:0:5896:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787360019.367237:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360019.367265:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527861632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360019.367344:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360019.368015:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861632 00000100:00100000:2.0:1787360019.368027:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861632 00000100:00100000:2.0:1787360019.368168:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787360019.368181:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527861632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360019.368225:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360019.368303:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527861632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360019.368312:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787360019.369218:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527861632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787360019.494978:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360020.520662:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787360020.574959:0:12875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:53:38 (1787360018) 00000100:00100000:2.0:1787360021.434095:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787360021.434119:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527861760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360021.434203:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360021.434282:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861760 00000100:00100000:2.0:1787360021.434294:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861760 00000100:00100000:2.0:1787360021.434367:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360021.434379:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527861760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360021.434421:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360021.434475:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527861760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360021.434483:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787360021.434506:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360021.434555:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527861760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787360021.546121:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360022.569694:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360023.590927:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360023.631192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360023.631240:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360023.631285:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360023.631311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360023.631335:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360023.631366:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509007104 00000100:00100000:3.0:1787360023.631378:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509007104 00000100:00100000:3.0:1787360023.631445:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006720 00000100:00100000:3.0:1787360023.631449:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006720 00000100:00100000:3.0:1787360023.631489:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 165 00000100:00100000:3.0:1787360023.631501:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+6:2365:x1874182509007104:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360023.631585:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:656feb27-2023-42fb-9cb9-36f15421ff39+6:2365:x1874182509007104:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.631594:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 165 00000100:00100000:3.0:1787360023.631613:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 166 00000100:00100000:3.0:1787360023.631620:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:2365:x1874182509006720:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360023.631647:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:2365:x1874182509006720:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.631653:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 166 00000100:00100000:3.0:1787360023.631730:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006848 00000100:00100000:3.0:1787360023.631746:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006848 00000100:00100000:3.0:1787360023.631775:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006976 00000100:00100000:3.0:1787360023.631778:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006976 00000100:00100000:3.0:1787360023.631800:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 98 00000100:00100000:3.0:1787360023.631807:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182509006848:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360023.631836:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2365:x1874182509006848:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.631843:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 98 00000100:00100000:3.0:1787360023.631854:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00100000:3.0:1787360023.631860:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2365:x1874182509006976:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360023.631897:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2365:x1874182509006976:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.631904:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00080000:3.0:1787360023.631919:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360023.631924:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360023.631926:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360023.632032:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509006592 00000100:00100000:0.0:1787360023.632037:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509006592 00000100:00100000:0.0:1787360023.632074:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 301 00000100:00100000:0.0:1787360023.632081:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182509006592:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360023.632110:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03658e77-9945-4faf-b424-380f2de8cb18+13:2365:x1874182509006592:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 30us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360023.632117:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 301 00000100:00100000:1.0:1787360023.975134:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d27f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527862144:0@lo:400:kworker.0 00000100:00100000:1.0:1787360023.975213:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360023.975284:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787360023.975291:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527862016:0@lo:400:kworker.0 00000100:00100000:1.0:1787360023.975326:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360023.975342:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527862528:0@lo:400:kworker.0 00000100:00100000:1.0:1787360023.975366:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360023.975483:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3a038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527861888:0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.975519:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360023.975552:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527862400:0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.975574:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360023.975594:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360023.975600:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527862272:0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.975621:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360023.975663:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862144 00000100:00100000:3.0:1787360023.975673:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862144 00000100:00100000:3.0:1787360023.975776:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862016 00000100:00100000:3.0:1787360023.975780:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862016 00000100:00100000:3.0:1787360023.975792:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862400 00000100:00100000:3.0:1787360023.975794:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862400 00000100:00100000:3.0:1787360023.975810:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787360023.975820:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527862144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.975887:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527862144:12345-0@lo:400:kworker.0 Request processed in 68us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.975895:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787360023.975914:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787360023.975920:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527862016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.975945:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527862016:12345-0@lo:400:kworker.0 Request processed in 26us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.975951:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787360023.975960:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787360023.975966:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527862400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.975993:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527862400:12345-0@lo:400:kworker.0 Request processed in 27us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.975998:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787360023.976021:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862528 00000100:00100000:3.0:1787360023.976024:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862528 00000100:00100000:3.0:1787360023.976047:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862272 00000100:00100000:3.0:1787360023.976050:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862272 00000100:00100000:3.0:1787360023.976067:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360023.976072:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527862528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.976102:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527862528:12345-0@lo:400:kworker.0 Request processed in 30us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.976117:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787360023.976128:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787360023.976133:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527862272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.976161:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527862272:12345-0@lo:400:kworker.0 Request processed in 28us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360023.976166:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787360023.976188:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787360023.976192:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787360023.976194:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360023.976220:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527862272:0@lo:400:kworker.0 00000100:00100000:3.0:1787360023.976231:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527862400:0@lo:400:kworker.0 00000100:00100000:1.0:1787360023.976977:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527861888 00000100:00100000:1.0:1787360023.976985:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527861888 00000100:00100000:2.0:1787360023.977411:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527862016:0@lo:400:kworker.0 00000100:00100000:2.0:1787360023.977425:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d086d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527862528:0@lo:400:kworker.0 00000100:00100000:2.0:1787360023.977432:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d27f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527862144:0@lo:400:kworker.0 00000100:00100000:0.0:1787360023.977973:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787360023.977987:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527861888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360023.978065:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527861888:12345-0@lo:400:kworker.0 Request processed in 82us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360023.978072:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787360023.978187:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3a038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527861888:0@lo:400:kworker.0 00000100:00100000:0.0:1787360024.477121:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360024.477240:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509007360 00000100:00100000:1.0:1787360024.477254:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509007360 00000100:00100000:1.0:1787360024.477334:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:1.0:1787360024.477347:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+18:12330:x1874182509007360:12345-192.168.201.14@tcp:35:umount.0 00000100:00100000:1.0:1787360024.478032:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:12330:x1874182509007360:12345-192.168.201.14@tcp:35:umount.0 Request processed in 685us (918us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787360024.478042:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 66 00000100:00100000:0.0:1787360024.484003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360024.484669:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509007616 00000100:00100000:1.0:1787360024.484710:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509007616 00000100:00100000:1.0:1787360024.484851:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 67 00000100:00100000:1.0:1787360024.484876:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+19:12330:x1874182509007616:12345-192.168.201.14@tcp:35:umount.0 00000100:00100000:1.0:1787360024.485263:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:12330:x1874182509007616:12345-192.168.201.14@tcp:35:umount.0 Request processed in 388us (1268us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787360024.485273:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 67 00000100:00100000:3.0:1787360024.491290:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360024.492772:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527862656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360024.492840:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360024.492937:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862656 00000100:00100000:0.0:1787360024.492948:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862656 00000100:00100000:0.0:1787360024.493002:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787360024.493012:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527862656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360024.493052:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787360024.493101:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527862656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360024.493109:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787360024.493159:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527862656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360024.508105:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509007872 00000100:00100000:2.0:1787360024.508124:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509007872 00000100:00100000:3.0:1787360024.509945:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 68 00000100:00100000:3.0:1787360024.509962:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1056b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+20:12330:x1874182509007872:12345-192.168.201.14@tcp:35:umount.0 00000100:00100000:3.0:1787360024.510482:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1056b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:12330:x1874182509007872:12345-192.168.201.14@tcp:35:umount.0 Request processed in 521us (19202us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787360024.510492:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 68 00000100:00100000:0.0:1787360024.514147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360024.514240:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509008128 00000100:00100000:1.0:1787360024.514254:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509008128 00000100:00100000:1.0:1787360024.514345:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:1.0:1787360024.514358:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:12330:x1874182509008128:12345-192.168.201.14@tcp:35:umount.0 00000100:00100000:1.0:1787360024.514787:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:12330:x1874182509008128:12345-192.168.201.14@tcp:35:umount.0 Request processed in 429us (651us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787360024.514796:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 69 00000100:00100000:0.0:1787360024.532917:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360024.532961:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360024.533003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360024.535766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360024.539700:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509008384 00000100:00100000:2.0:1787360024.539718:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509008384 00000100:00100000:2.0:1787360024.539783:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509008896 00000100:00100000:2.0:1787360024.539786:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509008896 00000100:00100000:2.0:1787360024.539866:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 74 00000100:00100000:2.0:1787360024.539879:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+7:2361:x1874182509008896:12345-192.168.201.14@tcp:9:umount.0 00000020:00000080:2.0:1787360024.539934:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3ca2 00000020:00010000:2.0:1787360024.539942:0:6700:0:(genops.c:1921:obd_stale_export_put()) Put export ffff983d0321e000: total 0 00000100:00080000:2.0:1787360024.539947:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983d0321b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787360024.539981:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787360024.540264:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2361:x1874182509008896:12345-192.168.201.14@tcp:9:umount.0 Request processed in 386us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360024.540273:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 74 00000020:00010000:2.0:1787360024.540300:0:5849:0:(genops.c:1907:obd_stale_export_get()) Get export ffff983d0321e000: total 0 00010000:00010000:2.0:1787360024.540323:0:5849:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff983d0321e000, canceled 0 locks, left on hash table 2. 00000100:00100000:0.0:1787360024.540640:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509008256 00000100:00100000:0.0:1787360024.540647:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509008256 00000100:00100000:0.0:1787360024.540661:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509008512 00000100:00100000:0.0:1787360024.540664:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509008512 00000100:00100000:0.0:1787360024.540693:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:0.0:1787360024.540701:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+15:2365:x1874182509008384:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360024.540715:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360024.540735:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62e00/0x72f6de40e4ef36cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3bf expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360024.540754:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360024.540778:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+14:2365:x1874182509008384:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 78us (7873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360024.540784:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:0.0:1787360024.540799:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:0.0:1787360024.540805:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+13:2364:x1874182509008256:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360024.540814:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360024.540823:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b63600/0x72f6de40e4ef3707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3f7 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360024.540832:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360024.540848:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+12:2364:x1874182509008256:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 43us (7887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360024.540876:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:0.0:1787360024.540890:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:0.0:1787360024.540896:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+11:2364:x1874182509008512:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360024.540903:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360024.540911:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c3c00/0x72f6de40e4ef397d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4c2 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360024.540919:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360024.540937:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+10:2364:x1874182509008512:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 42us (7936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360024.540944:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00010000:00010000:2.0:1787360024.544841:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef46e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce865 expref: 4 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.544916:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093efa61/0x72f6de40e4ef4045 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce697 expref: 3 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.544934:0:5849:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff983d0321e000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787360024.544969:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360024.544972:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360024.544974:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360024.548990:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360024.549082:0:12078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509009024 00000100:00100000:3.0:1787360024.549094:0:12078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509009024 00000100:00100000:3.0:1787360024.549254:0:12078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:3.0:1787360024.549268:0:12078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+5:2361:x1874182509009024:12345-192.168.201.14@tcp:9:umount.0 00000020:00000080:3.0:1787360024.549304:0:12078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3a41 00000100:00080000:3.0:1787360024.549313:0:12078:0:(import.c:65:import_set_state_nolock()) ffff983d054df000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360024.549369:0:12078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787360024.551065:0:12078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+2:2361:x1874182509009024:12345-192.168.201.14@tcp:9:umount.0 Request processed in 1790us (2075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360024.551081:0:12078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 75 00010000:00010000:1.0:1787360024.551232:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360024.564232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360024.564377:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509010048 00000100:00100000:3.0:1787360024.564390:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509010048 00000100:00100000:3.0:1787360024.564465:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 240 00000100:00100000:3.0:1787360024.564478:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+22:2361:x1874182509010048:12345-192.168.201.14@tcp:39:umount.0 00000020:00000080:3.0:1787360024.564516:0:5861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef36dd 00000020:00010000:3.0:1787360024.564533:0:5861:0:(genops.c:1921:obd_stale_export_put()) Put export ffff983d407fc800: total 0 00000100:00080000:3.0:1787360024.564538:0:5861:0:(import.c:65:import_set_state_nolock()) ffff983d407f9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360024.564585:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1787360024.565020:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b5a77f8-dccb-4cf2-aff0-2d737bdb5430+21:2361:x1874182509010048:12345-192.168.201.14@tcp:39:umount.0 Request processed in 544us (797us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787360024.565029:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 240 00000020:00010000:2.0:1787360024.565446:0:6714:0:(genops.c:1907:obd_stale_export_get()) Get export ffff983d407fc800: total 0 00010000:00010000:2.0:1787360024.565489:0:6714:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff983d407fc800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787360024.565524:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360024.565527:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360024.565536:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346800/0x72f6de40e4ef46a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce850 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565554:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:2.0:1787360024.565581:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360024.565586:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05347a00/0x72f6de40e4ef40a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6b3 expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565602:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d09750a00) 00010000:00010000:2.0:1787360024.565604:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360024.565608:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef39c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4d7 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565624:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787360024.565626:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360024.565630:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3e00/0x72f6de40e4ef4006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce682 expref: 17 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565642:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360024.565644:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360024.565648:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40400/0x72f6de40e4ef43a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce78c expref: 16 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565658:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360024.565660:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787360024.565663:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d05346400/0x72f6de40e4ef46ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce85e expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565673:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff983d20336e00) 00010000:00010000:2.0:1787360024.565723:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360024.565728:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2a00/0x72f6de40e4ef39a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4d0 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565757:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787360024.565760:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787360024.565763:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3200/0x72f6de40e4ef4030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce690 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565773:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff983d20336000) 00010000:00010000:2.0:1787360024.565776:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360024.565779:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef3f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce64a expref: 12 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565793:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:2.0:1787360024.565796:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787360024.565799:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63200/0x72f6de40e4ef3a17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4ec expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565810:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff983d20336b00) 00010000:00010000:2.0:1787360024.565812:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360024.565815:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c3000/0x72f6de40e4ef45c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce818 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565827:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff983d0947c300) 00010000:00010000:2.0:1787360024.565829:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787360024.565832:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef3d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce5be expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565843:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360024.565845:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787360024.565868:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef40c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce6ba expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360024.565883:0:6714:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff983d407fc800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787360024.565895:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360024.565897:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360024.565900:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360024.615739:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360025.639459:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360025.696293:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360025.696499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360025.708736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360025.717008:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509010176 00000100:00100000:0.0:1787360025.717026:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509010176 00000100:00100000:3.0:1787360025.717273:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509010432 00000100:00100000:3.0:1787360025.717277:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509010432 00000100:00100000:3.0:1787360025.717292:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509010304 00000100:00100000:3.0:1787360025.717294:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509010304 00000100:00100000:3.0:1787360025.717316:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:2.0:1787360025.717320:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360025.717327:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+12:2365:x1874182509010176:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360025.717349:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360025.717377:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165b000/0x72f6de40e4ef37af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce40c expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360025.717401:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360025.717427:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:0.0:1787360025.717437:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+11:2365:x1874182509010432:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360025.717446:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360025.717456:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40c00/0x72f6de40e4ef3976 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce4bb expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360025.717465:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360025.717471:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182509010176:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 145us (21188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360025.717479:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:0.0:1787360025.717484:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+10:2365:x1874182509010432:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 51us (20987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360025.717634:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509010688 00000100:00100000:2.0:1787360025.717639:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509010688 00000100:00100000:2.0:1787360025.717706:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 241 00000100:00100000:2.0:1787360025.717714:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+6:2361:x1874182509010688:12345-192.168.201.14@tcp:39:umount.0 00000020:00000080:2.0:1787360025.717759:0:10018:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef37c4 00000020:00010000:2.0:1787360025.717766:0:10018:0:(genops.c:1921:obd_stale_export_put()) Put export ffff983d399b1800: total 0 00000100:00080000:2.0:1787360025.717772:0:10018:0:(import.c:65:import_set_state_nolock()) ffff983d399b2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787360025.717794:0:10018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1787360025.717982:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d086d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:656feb27-2023-42fb-9cb9-36f15421ff39+5:2361:x1874182509010688:12345-192.168.201.14@tcp:39:umount.0 Request processed in 268us (661us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787360025.717990:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 241 00000020:00010000:2.0:1787360025.718025:0:6714:0:(genops.c:1907:obd_stale_export_get()) Get export ffff983d399b1800: total 0 00010000:00010000:2.0:1787360025.718028:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360025.718067:0:6714:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff983d399b1800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787360025.718107:0:6714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d25919100) 00010000:00010000:2.0:1787360025.718111:0:6714:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360025.718124:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d200c2400/0x72f6de40e4ef46f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce86c expref: 4 pid: 10018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360025.718151:0:6714:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff983d399b1800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787360025.718160:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360025.718162:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360025.718164:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360025.718187:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360025.719077:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:0.0:1787360025.720363:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:0.0:1787360025.720384:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+8:2365:x1874182509010304:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360025.720418:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360025.720440:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f41e00/0x72f6de40e4ef37b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce436 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360025.720456:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360025.720506:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03658e77-9945-4faf-b424-380f2de8cb18+7:2365:x1874182509010304:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 132us (11783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360025.720514:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:2.0:1787360025.752204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360025.752319:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509010944 00000100:00100000:3.0:1787360025.752350:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509010944 00000100:00100000:3.0:1787360025.752428:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 303 00000100:00100000:3.0:1787360025.752440:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+7:2361:x1874182509010944:12345-192.168.201.14@tcp:251:umount.0 00000020:00000080:3.0:1787360025.752494:0:5856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef36ba 00000020:00010000:3.0:1787360025.752502:0:5856:0:(genops.c:1921:obd_stale_export_put()) Put export ffff983d27d87000: total 0 00000100:00080000:3.0:1787360025.752508:0:5856:0:(import.c:65:import_set_state_nolock()) ffff983d27d85000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787360025.752753:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03658e77-9945-4faf-b424-380f2de8cb18+3:2361:x1874182509010944:12345-192.168.201.14@tcp:251:umount.0 Request processed in 304us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360025.752764:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 303 00000020:00010000:2.0:1787360025.756974:0:5849:0:(genops.c:1907:obd_stale_export_get()) Get export ffff983d27d87000: total 0 00010000:00010000:2.0:1787360025.757046:0:5849:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff983d27d87000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787360025.757104:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00030e00/0x72f6de40e4ef370e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce3fe expref: 2 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360025.757126:0:5849:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff983d27d87000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787360025.757136:0:5849:0:(genops.c:885:class_export_put()) final put ffff983d27d87000/03658e77-9945-4faf-b424-380f2de8cb18 00010000:00010000:2.0:1787360025.757167:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360025.757169:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360025.757172:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787360025.757297:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d27d87000/03658e77-9945-4faf-b424-380f2de8cb18 for MGS 00000020:00000080:1.0:1787360025.757348:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d27d85000 for MGS 00000100:00100000:2.0:1787360026.535033:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527862784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360026.535109:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360026.535309:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862784 00000100:00100000:0.0:1787360026.535320:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862784 00000100:00100000:0.0:1787360026.535391:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787360026.535403:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360026.535404:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527862784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787360026.535444:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787360026.535507:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d0643ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527862784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360026.535514:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787360026.536229:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527862784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787360026.662888:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787360027.369097:0:11690:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787360027.369106:0:11690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360027.369504:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787360027.369512:0:11690:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:1.0:1787360027.538785:0:13071:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360027.567162:0:13071:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787360027.567213:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567229:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567238:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567246:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567282:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360027.567288:0:13071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787360027.567316:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360027.567322:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567330:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40600 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360027.567334:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567342:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360027.567351:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360027.567357:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787360027.567359:0:6714:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787360027.567362:0:6714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787360027.567407:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567425:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360027.567449:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567457:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f40600/0x72f6de40e4ef374d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3754 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.567467:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360027.567474:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360027.567476:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360027.567498:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527862912:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787360027.567509:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360027.567514:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787360027.567520:0:13071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787360027.567534:0:13071:0:(import.c:65:import_set_state_nolock()) ffff983d1dc42800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787360027.567552:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527863040:0@lo:39:umount.0 00000100:00100000:0.0:1787360027.567564:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360027.567581:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360027.567637:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527862912 00000100:00100000:0.0:1787360027.567644:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527862912 00000100:00100000:1.0:1787360027.567852:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787360027.567865:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3318:x1874182527862912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360027.567881:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787360027.567898:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863040 00000100:00100000:2.0:1787360027.567902:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863040 00010000:00010000:1.0:1787360027.567902:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165a800/0x72f6de40e4ef3754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef374d expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360027.567916:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360027.567941:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787360027.567948:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874182527863040:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787360027.567970:0:5861:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef34d7 00000100:00080000:2.0:1787360027.567977:0:5861:0:(import.c:65:import_set_state_nolock()) ffff983d0dcf9000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787360027.568035:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3316:x1874182527863040:12345-0@lo:39:umount.0 Request processed in 87us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360027.568043:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787360027.568054:0:5861:0:(genops.c:885:class_export_put()) final put ffff983d0dcfa800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787360027.568074:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360027.568088:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6055641b-d743-4e3c-a711-70d92fdecc0d+18:3318:x1874182527862912:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360027.568104:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787360027.568182:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d1dc42800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787360027.568195:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527863040:0@lo:39:umount.0 00000100:00080000:2.0:1787360027.568216:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360027.568219:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787360027.568223:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360027.568230:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d0dcfa800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787360027.568346:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d0dcf9000 for lustre-MDT0000 00000100:00100000:0.0:1787360027.568376:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6055641b-d743-4e3c-a711-70d92fdecc0d:3318:1874182527862912:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360027.572435:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572456:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572463:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572469:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572496:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360027.572502:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572509:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572529:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572536:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572554:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787360027.572561:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572568:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572575:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572582:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572664:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787360027.572700:0:13071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572709:0:13071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572715:0:13071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572737:0:13071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.572747:0:13071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787360027.572752:0:13071:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787360027.572780:0:13071:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787360027.572784:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787360027.572788:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360027.572794:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1787360027.572811:0:13071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff983d27fba800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360027.572817:0:13071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff983d3f63b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360027.572824:0:13071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff983d399b1800 656feb27-2023-42fb-9cb9-36f15421ff39 192.168.201.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360027.572829:0:13071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff983d407fc800 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 192.168.201.14@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1787360027.572834:0:13071:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff983d111f19b8) has exports, disconnecting them 00000020:00080000:0.0:1787360027.572839:0:13071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff983d27fba800), last request at 1787360023 00000020:00000080:0.0:1787360027.572847:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef363c 00000100:00080000:0.0:1787360027.572864:0:13071:0:(import.c:65:import_set_state_nolock()) ffff983d27fbf800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787360027.572904:0:13071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff983d27fba800): rc 0 00000020:00000080:0.0:1787360027.572907:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d27fba800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787360027.572918:0:13071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff983d3f63b800), last request at 1787360023 00000020:00000080:0.0:1787360027.572921:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3571 00000100:00080000:0.0:1787360027.572926:0:13071:0:(import.c:65:import_set_state_nolock()) ffff983d39d9c000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787360027.572950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d27fba800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1787360027.572993:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00000080:0.0:1787360027.572997:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d27fbf800 for lustre-MDT0000 00010000:00010000:2.0:1787360027.573002:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573013:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a600 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787360027.573018:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573029:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787360027.573032:0:13071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff983d3f63b800): rc 0 00000020:00000080:0.0:1787360027.573038:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d3f63b800/lustre-MDT0000-lwp-OST0000_UUID 10000000:00010000:2.0:1787360027.573042:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360027.573051:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360027.573054:0:6714:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000004:00000080:0.0:1787360027.573059:0:13071:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbdef80c8fae0 10000000:01000000:2.0:1787360027.573067:0:6714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00000080:0.0:1787360027.573069:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3f63b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787360027.573095:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d39d9c000 for lustre-MDT0000 00010000:00010000:2.0:1787360027.573110:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787360027.573115:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787360027.573120:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1787360027.573127:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:0.0:1787360027.573135:0:13071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1787360027.573151:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573160:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165a600/0x72f6de40e4ef375b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3762 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573172:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787360027.573176:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573182:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01677200 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787360027.573186:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573194:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360027.573200:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360027.573214:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360027.573218:0:6714:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:0.0:1787360027.573218:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d0643f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527863168:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1787360027.573222:0:6714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787360027.573237:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573245:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787360027.573250:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573266:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01677200/0x72f6de40e4ef3674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef367b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573280:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360027.573284:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573290:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41600 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787360027.573293:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573301:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573307:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1787360027.573314:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360027.573321:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787360027.573324:0:6714:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787360027.573326:0:6714:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787360027.573339:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573345:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787360027.573361:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573364:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1787360027.573372:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41600/0x72f6de40e4ef3968 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef396f expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573374:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527863296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360027.573397:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360027.573401:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573404:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360027.573412:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d01485a00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:2.0:1787360027.573415:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360027.573423:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360027.573430:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360027.573436:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360027.573439:0:6714:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:0.0:1787360027.573439:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527863424:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1787360027.573443:0:6714:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787360027.573462:0:6714:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573470:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787360027.573476:0:6714:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787360027.573484:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573490:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1787360027.573491:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01485a00/0x72f6de40e4ef3428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef342f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.573499:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527863552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787360027.573507:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360027.573512:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360027.573521:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360027.573522:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360027.573555:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863168 00000100:00100000:0.0:1787360027.573563:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863168 00000100:00100000:0.0:1787360027.573603:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863296 00000100:00100000:0.0:1787360027.573606:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863296 00000100:00100000:0.0:1787360027.573621:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863424 00000100:00100000:0.0:1787360027.573624:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863424 00000100:00100000:0.0:1787360027.573639:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863552 00000100:00100000:0.0:1787360027.573641:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863552 00000100:00100000:0.0:1787360027.573663:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787360027.573737:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+21:3319:x1874182527863168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360027.573754:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360027.573769:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef3762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef375b expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.573790:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360027.573843:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+20:3319:x1874182527863168:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.573852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787360027.573876:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787360027.573885:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+19:3319:x1874182527863296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360027.573894:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360027.573904:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d01676600/0x72f6de40e4ef367b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3674 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.573921:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360027.573950:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+18:3319:x1874182527863296:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.573958:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787360027.573978:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787360027.573985:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360027.573985:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+17:3317:x1874182527863424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360027.573996:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787360027.574008:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787360027.574009:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62400/0x72f6de40e4ef396f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3968 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360027.574022:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360027.574023:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3317:x1874182527863552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360027.574036:0:8457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360027.574048:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef342f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3428 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360027.574056:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6055641b-d743-4e3c-a711-70d92fdecc0d+16:3317:x1874182527863424:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (586us total) trans 0 rc 0/0 00010000:00010000:3.0:1787360027.574065:0:8457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360027.574066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360027.574104:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3317:x1874182527863552:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360027.574111:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527863552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360027.574112:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787360027.574127:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527863424:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787360027.574168:0:13071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787360027.574184:0:13071:0:(import.c:65:import_set_state_nolock()) ffff983c02487800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787360027.574204:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787360027.574207:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1787360027.574218:0:13071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360027.574219:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527863680:0@lo:9:umount.0 00000100:00100000:3.0:1787360027.574255:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360027.574294:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863680 00000100:00080000:0.0:1787360027.574295:0:13071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787360027.574298:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863680 00000100:00080000:0.0:1787360027.574306:0:13071:0:(import.c:65:import_set_state_nolock()) ffff983d3f388000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787360027.574332:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787360027.574342:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874182527863680:12345-0@lo:9:umount.0 00000020:00080000:0.0:1787360027.574349:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff983d111f19b8) has no exports 00000020:00000080:3.0:1787360027.574373:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef35be 00000100:00080000:3.0:1787360027.574381:0:6700:0:(import.c:65:import_set_state_nolock()) ffff983c02484800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787360027.574418:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787360027.574579:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3316:x1874182527863680:12345-0@lo:9:umount.0 Request processed in 239us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.574586:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787360027.574604:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527863808:0@lo:9:umount.0 00000100:00100000:3.0:1787360027.574625:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787360027.574649:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983c02487800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787360027.574657:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787360027.574659:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787360027.574662:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527863680:0@lo:9:umount.0 00000100:00100000:2.0:1787360027.574988:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527863296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360027.574997:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d0643f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6055641b-d743-4e3c-a711-70d92fdecc0d:3319:1874182527863168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360027.575124:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863808 00000100:00100000:3.0:1787360027.575128:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863808 00000100:00100000:3.0:1787360027.575169:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787360027.575175:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874182527863808:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787360027.575191:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef36a5 00000100:00080000:3.0:1787360027.575196:0:6701:0:(import.c:65:import_set_state_nolock()) ffff983d407fc000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1787360027.575261:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1787360027.575294:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1787360027.575440:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3316:x1874182527863808:12345-0@lo:9:umount.0 Request processed in 264us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360027.575447:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1787360027.575540:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360027.575650:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d3f388000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1787360027.575784:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787360027.575925:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:1.0:1787360027.576107:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787360027.576117:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360027.576123:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527863808:0@lo:9:umount.0 00000020:00080000:3.0:1787360027.585172:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff983d111f19b8) has no exports 00000020:00000080:3.0:1787360027.627561:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3483 00000020:00000080:3.0:1787360027.627578:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d32cc6000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787360027.627604:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787360027.627648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d32cc6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787360027.630858:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360027.630876:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787360027.630881:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff983d086099b8) has no exports 00000020:00000080:2.0:1787360027.637348:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef347c 00000020:00000080:2.0:1787360027.637365:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d4156e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787360027.643726:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d4156e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360027.643971:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360027.643985:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787360027.643992:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d1df9d800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787360027.643996:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1df9d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787360027.644006:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787360027.686987:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787360028.192541:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360028.192552:0:6724:0:(genops.c:885:class_export_put()) final put ffff983c02483000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787360028.192585:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:1.0:1787360028.192588:0:6724:0:(genops.c:885:class_export_put()) final put ffff983d054d9800/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:0.0:1787360028.192847:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983c02483000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787360028.192904:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d054d9800/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 for lustre-OST0000 00000020:00000080:0.0:1787360028.192919:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983c02484800 for lustre-OST0000 00000020:00000080:0.0:1787360028.192924:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d054df000 for lustre-OST0000 00010000:00010000:0.0:1787360028.716071:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360029.095094:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527864192:0@lo:400:kworker.0 00000100:00100000:3.0:1787360029.095190:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360029.095340:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527864064:0@lo:400:kworker.0 00000100:00100000:0.0:1787360029.095371:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360029.095402:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360029.095408:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527863936:0@lo:400:kworker.0 00000100:00100000:2.0:1787360029.095701:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864192 00000100:00100000:2.0:1787360029.095712:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864192 00000100:00100000:2.0:1787360029.095751:0:10018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864064 00000100:00100000:2.0:1787360029.095754:0:10018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864064 00000100:00100000:2.0:1787360029.095784:0:10018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787360029.095794:0:10018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1874182527864192:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787360029.095803:0:10018:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787360029.095882:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360029.095944:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787360029.095950:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3320:x1874182527864064:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787360029.095955:0:5862:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787360029.095987:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3320:x1874182527864064:12345-0@lo:400:kworker.0 Request processed in 35us (614us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787360029.095996:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787360029.096021:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527863936 00000100:00100000:0.0:1787360029.096039:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527863936 00000100:00100000:0.0:1787360029.096075:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787360029.096082:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3320:x1874182527863936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360029.096122:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d181b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6055641b-d743-4e3c-a711-70d92fdecc0d+14:3320:x1874182527863936:12345-0@lo:400:kworker.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360029.096127:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787360029.096660:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527863936:0@lo:400:kworker.0 00000100:00080000:0.0:1787360029.096696:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787360029.096702:0:3320:0:(import.c:65:import_set_state_nolock()) ffff983d3f63e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787360029.096706:0:3320:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787360029.108561:0:10018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1874182527864192:12345-0@lo:400:kworker.0 Request processed in 12752us (13356us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787360029.108577:0:10018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1787360029.120481:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787360029.120491:0:3317:0:(import.c:65:import_set_state_nolock()) ffff983d27d85800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787360029.120497:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787360029.120503:0:3317:0:(import.c:65:import_set_state_nolock()) ffff983d27d85800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360029.120508:0:3317:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 216 00000100:00080000:3.0:1787360029.120518:0:3317:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff983d27d85800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:3.0:1787360029.120563:0:3317:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f8cea00 x1874182527864320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787360029.120596:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1874182527864192:0@lo:400:kworker.0 00000100:00100000:2.0:1787360029.122106:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527864320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787360029.122197:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360029.122272:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864320 00000100:00100000:2.0:1787360029.122282:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864320 00000100:00100000:2.0:1787360029.123170:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787360029.123182:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1874182527864320:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787360029.123205:0:5862:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787360029.133241:0:3320:0:(import.c:65:import_set_state_nolock()) ffff983d3f63e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360029.133252:0:3320:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1787360029.133261:0:3320:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff983d3f63e800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787360029.134026:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d40994700 x1874182527864448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360029.134054:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527864064:0@lo:400:kworker.0 00000100:00100000:0.0:1787360029.134114:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1874182527864448:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787360029.134192:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360029.134244:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864448 00000100:00100000:0.0:1787360029.134254:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864448 00000100:00100000:0.0:1787360029.134295:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787360029.134318:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1874182527864448:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787360029.134338:0:5863:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787360029.134386:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1874182527864448:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 81us (194us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787360029.134403:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787360029.134458:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d3f63e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787360029.134463:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787360029.134466:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1874182527864448:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787360029.159942:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1874182527864320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 36747us (37732us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360029.159958:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1787360029.160028:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d27d85800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360029.160034:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787360029.160039:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527864320:0@lo:38:ptlrpcd_00_00.0 00000001:00080000:3.0:1787360029.189714:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1787360029.189746:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 656feb27-2023-42fb-9cb9-36f15421ff39 00000001:00080000:3.0:1787360029.189752:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787360029.189755:0:5884:0:(genops.c:885:class_export_put()) final put ffff983d399b1800/656feb27-2023-42fb-9cb9-36f15421ff39 00000001:00100000:3.0:1787360029.189780:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000001:00080000:3.0:1787360029.189787:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787360029.189791:0:5884:0:(genops.c:885:class_export_put()) final put ffff983d407fc800/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:1.0:1787360029.189826:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d399b1800/656feb27-2023-42fb-9cb9-36f15421ff39 for lustre-MDT0000 00000020:00000080:1.0:1787360029.189885:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d407fc800/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 for lustre-MDT0000 00000020:00000080:1.0:1787360029.189918:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d399b2000 for lustre-MDT0000 00000020:00000080:1.0:1787360029.189925:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d407f9800 for lustre-MDT0000 00000020:01000000:2.0:1787360029.670867:0:13071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d27d474e0 - data ffff983d3fc96948/ffff983d27f96800 00000020:01000000:2.0:1787360029.671019:0:13071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d337f0960 - data ffff983d33829510/ffff983d2759f000 00000001:00100000:2.0:1787360029.683779:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000020:00000080:2.0:1787360029.683790:0:7649:0:(genops.c:885:class_export_put()) final put ffff983d0321e000/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 00000001:00100000:2.0:1787360029.683815:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787360029.683817:0:7649:0:(genops.c:885:class_export_put()) final put ffff983d407f8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787360029.683909:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d0321e000/2b5a77f8-dccb-4cf2-aff0-2d737bdb5430 for lustre-OST0001 00000020:00000080:1.0:1787360029.683958:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d407f8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787360029.683974:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d0321b800 for lustre-OST0001 00000020:00000080:1.0:1787360029.683979:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d407fc000 for lustre-OST0001 00000001:00000004:0.0:1787360029.690396:0:13071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:1.0:1787360029.748695:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787360029.781915:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787360029.781926:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787360029.783067:0:13071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360029.783074:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787360029.783740:0:6950:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787360029.783747:0:6950:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787360029.783759:0:6950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787360029.785038:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787360029.785045:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1787360029.785065:0:13071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787360029.785068:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787360029.787370:0:8020:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787360029.787378:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787360029.787392:0:8020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787360029.844564:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef344b 00000020:00000080:0.0:1787360029.844578:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d06739000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787360029.845957:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3460 00000020:00000080:0.0:1787360029.845967:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d1df9c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787360029.845975:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787360029.845982:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360029.845989:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787360029.845993:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff983d111f0000) has no exports 00000004:01000000:0.0:1787360029.846161:0:13071:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787360029.846171:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef369e 00000020:00000080:0.0:1787360029.846175:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d407ff000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787360029.846179:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787360029.846182:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360029.846189:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787360029.846191:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff983d3f654d28) has no exports 00000020:00000080:0.0:1787360029.846198:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3697 00000020:00000080:0.0:1787360029.846201:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d3f388800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787360029.846558:0:13071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787360029.846563:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787360029.846568:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1787360029.846575:0:13071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787360029.846578:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360029.846610:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360029.846617:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360029.846622:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef35b7 00000020:00000080:0.0:1787360029.846638:0:13071:0:(genops.c:885:class_export_put()) final put ffff983c02484000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787360029.846643:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787360029.846646:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360029.846650:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787360029.846653:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff983d110119b8) has no exports 00000020:00000080:0.0:1787360029.846656:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef35b0 00000020:00000080:0.0:1787360029.846659:0:13071:0:(genops.c:885:class_export_put()) final put ffff983c02485000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787360029.847044:0:13071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787360029.847048:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787360029.847051:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787360029.847054:0:13071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787360029.847056:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787360029.847080:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360029.847087:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360029.847111:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360029.847115:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360029.847161:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3467 00000020:00000080:0.0:1787360029.847167:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d1df9e000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787360029.847171:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787360029.847175:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360029.847178:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787360029.847180:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff983d08608000) has no exports 00000020:00000080:0.0:1787360029.847197:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360029.847200:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787360029.847203:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef346e 00000020:00000080:0.0:1787360029.847206:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d1df9b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787360029.847214:0:13071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d0dccf000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787360029.847216:0:13071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d0dccf000 3 00000020:01000004:0.0:1787360029.847219:0:13071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff983d0dccf000 from lustre-MDT0000 00000020:00000080:0.0:1787360029.847236:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360029.847240:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787360029.847243:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d1dc6b800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787360029.847246:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1dc6b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787360029.847265:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787360029.847337:0:13071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787360029.847341:0:13071:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787360029.847344:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787360029.847347:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360029.847350:0:13071:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360029.847356:0:13071:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff983d1101c000 6055641b-d743-4e3c-a711-70d92fdecc0d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360029.847361:0:13071:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff983d11014d28) has exports, disconnecting them 00000020:00080000:0.0:1787360029.847365:0:13071:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff983d1101c000), last request at 1787359799 00000020:00000080:0.0:1787360029.847379:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef340c 00000020:00010000:0.0:1787360029.847384:0:13071:0:(genops.c:1921:obd_stale_export_put()) Put export ffff983d1101c000: total 8 00000100:00080000:0.0:1787360029.847388:0:13071:0:(import.c:65:import_set_state_nolock()) ffff983d11018000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787360029.847416:0:13071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff983d1101c000): rc 0 00000020:00080000:0.0:1787360029.847420:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff983d11014d28) has no exports 00000100:00100000:0.0:1787360029.847480:0:5855:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff983d087e6e00:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1787360029.847595:0:5853:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff983d087e7800:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1787360029.847641:0:5856:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff983d24c6a800:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1787360029.847716:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847724:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847730:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847735:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847740:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847745:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847750:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.847756:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787360029.847836:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d06739000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360029.847851:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1df9c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787360029.847863:0:37:0:(genops.c:885:class_export_put()) final put ffff983d1dc69000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787360029.847866:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1dc69000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787360029.847871:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360029.847990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d407ff000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787360029.847997:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3f388800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360029.848002:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d3f388000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787360029.848007:0:37:0:(genops.c:885:class_export_put()) final put ffff983d27fbd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787360029.848009:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d27fbd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787360029.848012:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360029.848043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983c02484000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787360029.848048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983c02485000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360029.848051:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983c02487800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787360029.848055:0:37:0:(genops.c:885:class_export_put()) final put ffff983d3f3a4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787360029.848057:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3f3a4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787360029.848060:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787360029.848129:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1df9e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787360029.848132:0:37:0:(genops.c:885:class_export_put()) final put ffff983d1df9d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787360029.848134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1df9d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787360029.848137:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787360029.848267:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1df9b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1787360029.848515:0:5849:0:(genops.c:1907:obd_stale_export_get()) Get export ffff983d1101c000: total 0 00010000:00010000:1.0:1787360029.848551:0:5849:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff983d1101c000, canceled 0 locks, left on hash table 8. 00000100:00100000:0.0:1787360029.848965:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1787360029.849028:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00030c00/0x72f6de40e4ef371c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3715 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849052:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00030000/0x72f6de40e4ef372a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3723 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849074:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef3746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef373f expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849085:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef3953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef394c expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849098:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165be00/0x72f6de40e4ef3738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3731 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849109:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef3961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef395a expref: 4 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849123:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d00031400/0x72f6de40e4ef3524 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef351d expref: 3 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849136:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef3770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x72f6de40e4ef3769 expref: 2 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360029.849146:0:5849:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff983d1101c000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787360029.849162:0:5849:0:(genops.c:885:class_export_put()) final put ffff983d1101c000/6055641b-d743-4e3c-a711-70d92fdecc0d 00010000:00010000:1.0:1787360029.849174:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360029.849176:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360029.849178:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787360029.849185:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1101c000/6055641b-d743-4e3c-a711-70d92fdecc0d for MGS 00000020:00000080:1.0:1787360029.849213:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d11018000 for MGS 00000100:00100000:0.0:1787360029.849480:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849491:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849497:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849503:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849509:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849515:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849527:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849533:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849538:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849544:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849550:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849556:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849570:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849576:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849582:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849587:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849593:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849598:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849604:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849609:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849615:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849620:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849625:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849771:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849777:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849783:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849788:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849793:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849798:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849804:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849809:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849813:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849818:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849823:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849828:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849833:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849838:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849843:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849847:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849853:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849859:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849872:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849877:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849883:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849889:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849894:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849900:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849906:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849912:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849917:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849924:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849929:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849936:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849941:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360029.849946:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787360029.850324:0:13071:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787360029.850329:0:13071:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787360029.852223:0:13071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d3f19e240 - data ffff983c01618510/ffff983d27fb0000 00000020:01000000:0.0:1787360029.852346:0:13071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d336ad240 - data ffff983d3382b000/ffff983d06449800 00000020:00000080:0.0:1787360029.852914:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef33f0 00000020:00000080:0.0:1787360029.852922:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d1101e800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787360029.852937:0:13071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d0dccf000 from MGS, refs=2 00000020:01000004:0.0:1787360029.852941:0:13071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d0dccf000 2 00000020:01000004:0.0:1787360029.852945:0:13071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff983d0dccf000 from MGS 00000020:00000080:0.0:1787360029.852966:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360029.852972:0:13071:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787360029.852975:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d114bc800/MGS 00000020:00000080:0.0:1787360029.852978:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff983d114bc800/MGS for MGS 00000020:01000000:0.0:1787360029.852985:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787360029.853058:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787360029.853061:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360029.853067:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360029.853073:0:13071:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff983d41568000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360029.853079:0:13071:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff983d32c7b370) has exports, disconnecting them 00000020:00080000:0.0:1787360029.853093:0:13071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff983d41568000), last request at 1787359800 00000020:00000080:0.0:1787360029.853097:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef34bb 00000020:00080000:0.0:1787360029.853107:0:13071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff983d41568000): rc 0 00000020:00000080:0.0:1787360029.853111:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d41568000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787360029.853772:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1101e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787360029.853784:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d41568000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787360029.854790:0:13071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787360029.854798:0:13071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360029.854811:0:13071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360029.854818:0:13071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360029.855211:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360029.855219:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787360029.855226:0:13071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d0dccf000 1 00000020:00000080:1.0:1787360029.855232:0:13071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef33e2 00000020:00000080:1.0:1787360029.855240:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d114be000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787360029.855266:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d1dc42800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787360029.855273:0:38:0:(genops.c:885:class_export_put()) final put ffff983d1dc47000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787360029.855276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1dc47000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787360029.855280:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1787360029.855499:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787360029.855504:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360029.855508:0:13071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787360029.855511:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff983d32c799b8) has no exports 00000020:00000080:2.0:1787360029.855717:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff983d114be000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787360029.885592:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360029.885616:0:13071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787360029.885629:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d0dcce000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787360029.885634:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff983d0dcce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787360029.885645:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787360029.885798:0:13071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff983d0dcca000 00000020:01000000:2.0:1787360029.885819:0:13071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787360029.885823:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360029.885827:0:13071:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787360029.885831:0:13071:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff983d111f4d28) has no exports 00000100:00100000:2.0:1787360029.885922:0:5862:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff983d0642b800:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1787360029.888429:0:5861:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff983d0642a000:5861] 0 exiting: rc = 1 00000100:00100000:1.0:1787360029.889320:0:5863:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff983d32c81c00:5863] 2 exiting: rc = 0 00000100:00100000:0.0:1787360029.889474:0:10018:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff983d409b1400:10018] 3 exiting: rc = 0 00000100:00100000:2.0:1787360029.889665:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889674:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889709:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889715:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889721:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889726:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889731:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889736:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889740:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889746:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889751:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889756:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889773:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889779:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889785:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889791:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889796:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889800:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889805:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889810:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889815:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889820:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889828:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889833:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889851:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889857:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889863:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889871:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889876:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889884:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889890:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889895:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889900:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889908:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889913:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889923:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889929:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889934:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889939:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889944:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889949:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889954:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889959:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889965:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889971:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889977:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889986:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889990:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.889995:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890000:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890005:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890010:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890016:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890021:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890025:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890030:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890034:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890038:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890043:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890058:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890064:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890071:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890076:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.890082:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.894377:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff983d0642b400:5864] 0 exiting: rc = 1 00000100:00100000:3.0:1787360029.894543:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff983d115c6600:5865] 1 exiting: rc = 0 00000100:00100000:2.0:1787360029.895194:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895202:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895209:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895216:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895222:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895227:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895233:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895238:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895243:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895248:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895253:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895259:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895266:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895271:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895275:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895280:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895285:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895289:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895294:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895298:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895302:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895307:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895313:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895317:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895324:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895328:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895333:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895338:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895343:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895348:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895365:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895369:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895376:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895381:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895386:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895392:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895397:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895402:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895407:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895411:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895416:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895421:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895426:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895431:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895436:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895441:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895446:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895451:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895456:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895461:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895466:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895471:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895476:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895481:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895488:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895493:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895498:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895504:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895509:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895514:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895519:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895525:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895530:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.895537:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.896306:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff983d11006800:5866] 0 exiting: rc = 1 00000100:00100000:1.0:1787360029.898072:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff983d11007400:5867] 1 exiting: rc = 0 00000100:00100000:2.0:1787360029.898232:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898241:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898247:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898257:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898266:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898271:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898277:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898284:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898290:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898306:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898312:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898318:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898323:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898329:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898334:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898340:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898345:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898351:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898356:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898362:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898367:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898387:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898393:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898399:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898405:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898411:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898417:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898422:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898427:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898433:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898440:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898445:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898450:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898468:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898474:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898489:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898495:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898501:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898508:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898514:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898519:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898525:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898530:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898537:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898543:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898561:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898568:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898573:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898579:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898585:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898591:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898597:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898602:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898609:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898614:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898619:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898624:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898657:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898664:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898670:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898700:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898708:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898735:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.898741:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.912556:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff983d32cd1c00:5868] 0 exiting: rc = 1 00000100:00100000:1.0:1787360029.912793:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff983d32cd1600:5869] 1 exiting: rc = 0 00000100:00100000:2.0:1787360029.912887:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912897:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912902:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912908:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912914:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912922:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912941:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912947:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912952:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912957:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912963:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912968:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912973:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912978:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912985:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912990:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.912995:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913000:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913006:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913011:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913016:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913021:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913026:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913030:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913035:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913040:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913046:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913051:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913056:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913061:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913066:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913072:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913077:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913082:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913087:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913093:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913098:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913103:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913108:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913113:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913118:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913129:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913134:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913139:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913145:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913150:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913155:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913160:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913165:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913169:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913174:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913178:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913182:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913187:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913191:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913195:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913200:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913205:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913210:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913215:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913220:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913225:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913230:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.913235:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.914621:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff983d337ac600:5871] 1 exiting: rc = 0 00000100:00100000:1.0:1787360029.914865:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff983d337ace00:5870] 0 exiting: rc = 1 00000100:00100000:2.0:1787360029.914957:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914965:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914971:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914976:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914981:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914986:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914991:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.914996:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915002:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915008:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915013:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915019:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915036:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915041:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915047:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915052:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915057:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915061:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915067:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915072:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915078:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915082:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915087:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915092:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915097:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915102:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915107:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915111:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915116:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915120:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915125:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915130:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915134:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915138:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915143:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915147:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915151:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915155:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915161:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915166:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915171:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915175:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915180:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915185:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915190:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915196:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915201:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915214:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915220:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915224:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915229:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915235:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915240:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915245:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915250:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915254:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915258:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915263:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915268:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915273:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915277:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915282:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915287:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.915292:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.915892:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff983d337ad600:5873] 1 exiting: rc = 0 00000100:00100000:3.0:1787360029.916087:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff983d337ad200:5872] 0 exiting: rc = 1 00000100:00100000:2.0:1787360029.916567:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916574:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916579:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916584:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916590:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916595:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916600:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916606:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916611:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916617:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916622:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916636:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916641:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916647:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916652:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916657:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916662:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916666:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916709:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916714:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916718:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916723:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916727:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916731:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916736:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916740:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916745:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916750:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916754:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916759:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916775:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916780:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916784:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916789:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916795:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916800:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916805:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916809:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916814:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916818:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916822:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916826:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916830:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916834:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916838:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916842:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916846:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916851:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916856:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916860:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916865:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916869:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916874:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916885:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916889:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916893:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916898:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916903:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916908:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916913:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916918:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916922:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916927:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360029.916931:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.917518:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff983d11007c00:5874] 0 exiting: rc = 1 00000100:00100000:1.0:1787360029.918117:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff983d11006a00:5875] 1 exiting: rc = 0 00000100:00100000:3.0:1787360029.918539:0:5876:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff983d0dcc5200:5876] 2 exiting: rc = 0 00000100:00100000:1.0:1787360029.919040:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919048:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919055:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919061:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919066:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919072:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919077:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919083:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919087:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919105:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919111:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919118:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919123:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919130:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919138:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919144:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919149:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919155:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919161:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919167:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919173:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919196:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919203:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919208:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919213:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919219:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919225:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919230:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919236:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919243:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919248:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919253:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919259:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919265:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919270:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919276:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919281:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919287:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919292:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919297:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919301:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919306:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919312:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919318:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919330:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919352:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919358:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919363:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919369:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919375:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919381:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919387:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919393:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919399:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919404:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919410:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919415:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919421:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919427:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919432:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919437:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919443:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919449:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360029.919454:0:13071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787360029.923514:0:13071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360029.923529:0:13071:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787360029.923535:0:13071:0:(genops.c:885:class_export_put()) final put ffff983d32cc5000/MDS_uuid 00000020:00000080:1.0:1787360029.923539:0:13071:0:(genops.c:844:class_export_destroy()) destroying export ffff983d32cc5000/MDS_uuid for MDS 00000020:01000000:1.0:1787360029.923545:0:13071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787360029.924024:0:13071:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787360030.769040:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360031.785737:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787360032.749635:0:13224:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787360032.770025:0:13224:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787360032.770083:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.770100:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.770108:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.770115:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.770143:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787360032.770149:0:13224:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787360032.770171:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360032.770175:0:13224:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787360032.770183:0:13224:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787360032.770190:0:13224:0:(import.c:65:import_set_state_nolock()) ffff983d3f63e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787360032.770195:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787360032.770196:0:13224:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787360032.770213:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787360032.770767:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360032.770778:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360032.770798:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63800 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787360032.770812:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360032.770822:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360032.770830:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360032.770836:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360032.770838:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787360032.770841:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787360032.770890:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360032.770898:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787360032.770934:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360032.770942:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d25b63800/0x72f6de40e4ef3731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3738 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360032.770957:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360032.770959:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360032.770961:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360032.770971:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360032.770989:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527864576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360032.771075:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360032.771261:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864576 00000100:00100000:0.0:1787360032.771270:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864576 00000100:00100000:0.0:1787360032.771326:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787360032.771335:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1874182527864576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787360032.771342:0:5847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360032 with bad export cookie 8284052934894760972 00010000:00010000:2.0:1787360032.773291:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773308:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773315:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773320:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773346:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360032.773353:0:13224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773360:0:13224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773365:0:13224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773371:0:13224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360032.773382:0:13224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787360032.773386:0:13224:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787360032.773409:0:13224:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787360032.773414:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787360032.773418:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360032.773435:0:13224:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787360032.773440:0:13224:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff983d11010000) has no exports 00000020:00080000:2.0:1787360032.773465:0:13224:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff983d11010000) has no exports 00000020:01000000:2.0:1787360032.779398:0:13224:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d3f19eb40 - data ffff983c016186c0/ffff983d27fb2400 00000020:01000000:2.0:1787360032.779578:0:13224:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d340d3420 - data ffff983d3382b360/ffff983c0246e400 00010000:00010000:1.0:1787360032.783165:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360032.783183:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783196:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787360032.783201:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783237:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360032.783245:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360032.783250:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360032.783252:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787360032.783256:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787360032.783308:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783314:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360032.783347:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783355:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f40000/0x72f6de40e4ef373f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3746 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783373:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360032.783377:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783383:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41c00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787360032.783385:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783392:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360032.783410:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360032.783415:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787360032.783417:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787360032.783419:0:5850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787360032.783431:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783437:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787360032.783442:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783449:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983c02f41c00/0x72f6de40e4ef395a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x72f6de40e4ef3961 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360032.783458:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360032.783460:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360032.783462:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360032.783469:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360032.783708:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527864832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360032.783799:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360032.783851:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360032.783858:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527864704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360032.783884:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360032.783915:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864832 00000100:00100000:1.0:1787360032.783923:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864832 00000100:00100000:1.0:1787360032.783962:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527864704 00000100:00100000:1.0:1787360032.783965:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527864704 00000100:00100000:1.0:1787360032.783989:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787360032.783997:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3320:x1874182527864832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787360032.784004:0:5846:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360032 with bad export cookie 8284052934894760972 00000100:00100000:1.0:1787360032.784052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3320:x1874182527864832:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (253us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360032.784060:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787360032.784077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360032.784081:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d337ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3320:x1874182527864704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787360032.784085:0:5846:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787360032 with bad export cookie 8284052934894760972 00000100:00100000:1.0:1787360032.784107:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d337ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3320:x1874182527864704:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (223us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787360032.784112:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787360032.784144:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787360032.784149:0:3320:0:(import.c:65:import_set_state_nolock()) ffff983d32cc5800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787360032.784153:0:3320:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1787360032.792133:0:3320:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.114@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787360032.792138:0:3320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787360032.792149:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff983d3f8cf100 x1874182527864576/t0(0) o103->MGC192.168.201.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360048 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360032.792178:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff983d3f98ed80 x1874182527864832/t0(0) o103->MGC192.168.201.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360048 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360032.792186:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff983d3f98c000 x1874182527864704/t0(0) o103->MGC192.168.201.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787360048 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787360032.792195:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787360032.792198:0:3320:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787360032.792199:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787360032.792204:0:3320:0:(import.c:65:import_set_state_nolock()) ffff983d32cc5800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360032.792208:0:3320:0:(import.c:510:import_select_connection()) MGC192.168.201.114@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:1.0:1787360032.792237:0:3320:0:(import.c:624:import_select_connection()) MGC192.168.201.114@tcp: import ffff983d32cc5800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360032.792275:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98ce00 x1874182527864960/t0(0) o250->MGC192.168.201.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360032.792322:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527864832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787360032.792347:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6055641b-d743-4e3c-a711-70d92fdecc0d:3320:1874182527864704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787360032.792483:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6055641b-d743-4e3c-a711-70d92fdecc0d:3317:1874182527864576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787360032.792642:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6055641b-d743-4e3c-a711-70d92fdecc0d:3316:1874182527864960:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787360032.792971:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874182527864960 offset 0 length 520: 4 00000400:00000100:0.0:1787360032.806399:0:5847:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874182527864576 offset 224 length 224: 4 00000100:00100000:0.0:1787360032.806433:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3317:x1874182527864576:12345-0@lo:103:ldlm_bl.0 Request processed in 35096us (35356us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787360032.806446:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787360032.809739:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787360032.825451:0:13224:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787360032.857859:0:13224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3540 00000020:00000080:0.0:1787360032.857872:0:13224:0:(genops.c:885:class_export_put()) final put ffff983d3f3a2800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787360032.857889:0:13224:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d200eb000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787360032.857893:0:13224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d200eb000 2 00000020:01000004:0.0:1787360032.857896:0:13224:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff983d200eb000 from lustre-OST0000 00000020:00000080:0.0:1787360032.857924:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787360032.857934:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787360032.857937:0:13224:0:(genops.c:885:class_export_put()) final put ffff983d3bd00800/lustre-OST0000_UUID 00000020:00000080:0.0:1787360032.857940:0:13224:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3bd00800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787360032.857947:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787360032.857991:0:13224:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787360032.857995:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787360032.857998:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360032.858014:0:13224:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787360032.858021:0:13224:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff983d3f63a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787360032.858027:0:13224:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff983d3f653370) has exports, disconnecting them 00000020:00080000:0.0:1787360032.858032:0:13224:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff983d3f63a000), last request at 1787359820 00000020:00000080:0.0:1787360032.858036:0:13224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef356a 00000020:00080000:0.0:1787360032.858046:0:13224:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff983d3f63a000): rc 0 00000020:00000080:0.0:1787360032.858052:0:13224:0:(genops.c:885:class_export_put()) final put ffff983d3f63a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787360032.858965:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3f3a2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787360032.858978:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3f63a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787360032.859771:0:13224:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787360032.859780:0:13224:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787360032.859787:0:13224:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787360032.859793:0:13224:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787360032.859983:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787360032.859992:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787360032.859998:0:13224:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d200eb000 1 00000020:00000080:1.0:1787360032.860003:0:13224:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef34fa 00000020:00000080:1.0:1787360032.860012:0:13224:0:(genops.c:885:class_export_put()) final put ffff983d200e8000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787360032.860017:0:13224:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787360032.860021:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787360032.860025:0:13224:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787360032.860028:0:13224:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff983d32c7cd28) has no exports 00000020:00000080:2.0:1787360032.860483:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d3f63e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787360032.860492:0:37:0:(genops.c:885:class_export_put()) final put ffff983d3f639800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787360032.860495:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d3f639800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787360032.860506:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787360032.860566:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d200e8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787360032.870050:0:13224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360032.870067:0:13224:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787360032.870073:0:13224:0:(genops.c:885:class_export_put()) final put ffff983d200ee000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787360032.870078:0:13224:0:(genops.c:844:class_export_destroy()) destroying export ffff983d200ee000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787360032.870086:0:13224:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787360032.870240:0:13224:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff983d200ed800 00000020:02000400:2.0:1787360032.870308:0:13224:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787360033.831155:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787360034.215105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6055641b-d743-4e3c-a711-70d92fdecc0d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360034.215116:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6055641b-d743-4e3c-a711-70d92fdecc0d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787360034.215119:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787360034.215123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787360034.215127:0:37:0:(import.c:65:import_set_state_nolock()) ffff983d27d85800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787360034.215136:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 403 00000100:00080000:3.0:1787360034.215143:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787360034.215205:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff983d27d85800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:3.0:1787360034.215251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f8cf100 x1874182527865088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360034.215481:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527865088:0@lo:38:kworker.0 00000400:00000100:1.0:1787360034.215545:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874182527865088 offset 0 length 520: 4 00010000:00010000:1.0:1787360034.855041:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787360035.408085:0:13374:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787360035.422284:0:13374:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787360035.422357:0:13374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.422374:0:13374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.422381:0:13374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.422389:0:13374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.422417:0:13374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360035.422423:0:13374:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787360035.422444:0:13374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360035.422458:0:13374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff983d3f8cf100 x1874182527865088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360035.422476:0:13374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787360035.422483:0:13374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360035.422491:0:13374:0:(import.c:65:import_set_state_nolock()) ffff983d27d85800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787360035.422496:0:13374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787360035.422511:0:13374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff983d3f8cf100 x1874182527865088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787360049 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360035.422518:0:13374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787360035.422522:0:13374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:3.0:1787360035.422602:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360035.422610:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360035.422619:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:3.0:1787360035.422977:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360035.422990:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787360035.422998:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360035.423004:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787360035.423006:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787360035.423009:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787360035.423026:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff983d32cc5800 00010000:00010000:3.0:1787360035.423039:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360035.423047:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef3715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef371c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360035.423060:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360035.423061:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360035.423063:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360035.423584:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527865088:0@lo:38:kworker.0 00010000:00010000:0.0:1787360035.424608:0:13374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.424620:0:13374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.424624:0:13374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.424628:0:13374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.424647:0:13374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787360035.424653:0:13374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.424658:0:13374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.424663:0:13374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.424784:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360035.424789:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.424806:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d00030a00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787360035.424809:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.424815:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360035.424820:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360035.424823:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787360035.424825:0:5850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787360035.424834:0:5850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff983d32cc5800 00010000:00010000:1.0:1787360035.424836:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.424840:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d00030a00/0x72f6de40e4ef3723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef372a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.424850:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360035.424851:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360035.424853:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360035.426905:0:13374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360035.426931:0:13374:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787360035.426953:0:13374:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787360035.426959:0:13374:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787360035.426990:0:13374:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787360035.426995:0:13374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787360035.427001:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787360035.427007:0:13374:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787360035.427010:0:13374:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff983d39bf3370) has no exports 00000020:00080000:0.0:1787360035.427032:0:13374:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff983d39bf3370) has no exports 00000020:01000000:0.0:1787360035.428498:0:13374:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d3f19e960 - data ffff983d3fdc9438/ffff983d2757a400 00000020:01000000:0.0:1787360035.428635:0:13374:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff983d32c1ef60 - data ffff983c016171b0/ffff983d3f65cc00 00010000:00010000:1.0:1787360035.429173:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360035.429183:0:6714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.429194:0:6714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:1.0:1787360035.429199:0:6714:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.429226:0:6714:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787360035.429233:0:6714:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360035.429239:0:6714:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787360035.429242:0:6714:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787360035.429246:0:6714:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787360035.429264:0:6714:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff983d32cc5800 00010000:00010000:1.0:1787360035.429268:0:6714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.429276:0:6714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef394c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef3953 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360035.429293:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360035.429295:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360035.429297:0:6714:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787360035.443778:0:13374:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787360035.469522:0:13374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef360b 00000020:00000080:2.0:1787360035.469531:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d1e3fa000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787360035.469547:0:13374:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d11588000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787360035.469551:0:13374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d11588000 2 00000020:01000004:2.0:1787360035.469553:0:13374:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff983d11588000 from lustre-OST0001 00000020:00000080:2.0:1787360035.469573:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360035.469581:0:13374:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787360035.469583:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d1158b000/lustre-OST0001_UUID 00000020:00000080:2.0:1787360035.469594:0:13374:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1158b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787360035.469600:0:13374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787360035.469751:0:13374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6055641b-d743-4e3c-a711-70d92fdecc0d->MGS 00010000:00010000:2.0:1787360035.469767:0:13374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360035.469777:0:13374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360035.469782:0:13374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787360035.469784:0:13374:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787360035.469786:0:13374:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787360035.469800:0:13374:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff983d32cc5800 00010000:00010000:2.0:1787360035.469803:0:13374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d01485600/0x72f6de40e4ef351d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef3524 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360035.469815:0:13374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787360035.469819:0:13374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360035.469823:0:13374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787360035.469824:0:13374:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787360035.469825:0:13374:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787360035.469832:0:13374:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff983d32cc5800 00010000:00010000:2.0:1787360035.469833:0:13374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d0165ae00/0x72f6de40e4ef3769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x72f6de40e4ef3770 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787360035.469845:0:13374:0:(import.c:65:import_set_state_nolock()) ffff983d32cc5800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787360035.469848:0:13374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787360035.469853:0:13374:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787360035.469854:0:13374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787360035.469858:0:13374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787360035.469869:0:13374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff983d3f98ce00 x1874182527864960/t0(0) o250->MGC192.168.201.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787360042 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787360035.469889:0:13374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787360035.469891:0:13374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1787360035.469950:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1e3fa000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787360035.469979:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6055641b-d743-4e3c-a711-70d92fdecc0d:3316:1874182527864960:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1787360035.470501:0:13374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787360035.470511:0:13374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef33fe 00000020:00000080:2.0:1787360035.470518:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d32cc7000/6055641b-d743-4e3c-a711-70d92fdecc0d 00000020:01000000:2.0:1787360035.470534:0:13374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.114@tcp (flags='') 00000020:00000080:2.0:1787360035.470540:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360035.470544:0:13374:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787360035.470548:0:13374:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff983d111f3370) has no exports 00000020:00000080:3.0:1787360035.470591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d32cc7000/6055641b-d743-4e3c-a711-70d92fdecc0d for MGC192.168.201.114@tcp 10000000:01000000:0.0:1787360035.470630:0:5858:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787360035.471165:0:13374:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.114@tcp: client import never connected 00000100:00080000:2.0:1787360035.471170:0:13374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787360035.471172:0:13374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787360035.471175:0:13374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787360035.471177:0:13374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787360035.471219:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787360035.471224:0:13374:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.114@tcp (uuid 6055641b-d743-4e3c-a711-70d92fdecc0d) 00000020:01000000:2.0:1787360035.471229:0:13374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787360035.471233:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787360035.471237:0:13374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787360035.471242:0:13374:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff983d27d87800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787360035.471248:0:13374:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff983d0860b370) has exports, disconnecting them 00000020:00080000:2.0:1787360035.471252:0:13374:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff983d27d87800), last request at 1787359841 00000020:00000080:2.0:1787360035.471256:0:13374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef3635 00000020:00080000:2.0:1787360035.471268:0:13374:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff983d27d87800): rc 0 00000020:00000080:2.0:1787360035.471271:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d27d87800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787360035.471380:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d32cc5800 for MGC192.168.201.114@tcp 00000020:00000080:3.0:1787360035.471388:0:37:0:(genops.c:885:class_export_put()) final put ffff983d114ba000/6055641b-d743-4e3c-a711-70d92fdecc0d 00000020:00000080:3.0:1787360035.471391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d114ba000/6055641b-d743-4e3c-a711-70d92fdecc0d for MGC192.168.201.114@tcp 00000020:01000000:3.0:1787360035.471398:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.114@tcp (6055641b-d743-4e3c-a711-70d92fdecc0d) 00000020:00000080:3.0:1787360035.471756:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983d27d87800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787360035.475741:0:13374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787360035.475750:0:13374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787360035.475755:0:13374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787360035.475762:0:13374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787360035.475834:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1787360035.476046:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff983d27d85800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787360035.477726:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787360035.477998:0:6714:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787360035.478180:0:5845:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff983d12581e00:5845] 1 exiting: rc = 0 00000100:00100000:3.0:1787360035.478743:0:5844:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff983d115c6400:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1787360035.483785:0:7638:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff983d3a207600:7638] 2 exiting: rc = 0 00000100:00100000:3.0:1787360035.484265:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.484571:0:8457:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff983d399fe600:8457] 3 exiting: rc = 0 00000100:00100000:0.0:1787360035.484707:0:5846:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff983d340c9000:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787360035.484773:0:5847:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff983d12581800:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787360035.484893:0:5848:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff983d12581200:5848] 2 exiting: rc = 0 00000100:00100000:3.0:1787360035.485001:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485009:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485017:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485024:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485032:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485052:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485059:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485065:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485071:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485078:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485083:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485089:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485094:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485100:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485106:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485112:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485119:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485126:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485132:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485138:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485143:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485149:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485154:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485159:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485164:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485169:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485174:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485180:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485185:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485190:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485195:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485199:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485204:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485209:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485215:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485222:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485227:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485232:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485236:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485242:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485255:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485260:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485265:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485270:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485275:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485280:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485284:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485289:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485293:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485298:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485303:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485309:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485313:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485318:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485323:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485328:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485333:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485338:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485342:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485348:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485353:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485358:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485363:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.485377:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787360035.486248:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360035.486258:0:13374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787360035.486264:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d1103b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787360035.486269:0:13374:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1103b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787360035.486275:0:13374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787360035.486318:0:13374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d11588000 1 00000020:00000080:3.0:1787360035.486324:0:13374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x72f6de40e4ef35da 00000020:00000080:3.0:1787360035.486331:0:13374:0:(genops.c:885:class_export_put()) final put ffff983c02482000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787360035.486350:0:13374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787360035.486355:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360035.486366:0:13374:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787360035.486370:0:13374:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff983d39bf19b8) has no exports 00000020:00000080:0.0:1787360035.487332:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff983c02482000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787360035.504512:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360035.504539:0:13374:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787360035.504545:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d1158c800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787360035.504551:0:13374:0:(genops.c:844:class_export_destroy()) destroying export ffff983d1158c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787360035.504562:0:13374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787360035.505236:0:13374:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff983d1158e000 00000020:01000000:3.0:1787360035.505262:0:13374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787360035.505267:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787360035.505272:0:13374:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787360035.505278:0:13374:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff983d32c78000) has no exports 00000020:00000080:3.0:1787360035.505350:0:13374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787360035.505360:0:13374:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787360035.505363:0:13374:0:(genops.c:885:class_export_put()) final put ffff983d200ec800/OSS_uuid 00000020:00000080:3.0:1787360035.505366:0:13374:0:(genops.c:844:class_export_destroy()) destroying export ffff983d200ec800/OSS_uuid for OSS 00000020:01000000:3.0:1787360035.505370:0:13374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787360035.505452:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff983d12594200:6701] 2 exiting: rc = 0 00000100:00100000:3.0:1787360035.505577:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff983d24e40c00:6698] 0 exiting: rc = 1 00000100:00100000:3.0:1787360035.505630:0:12078:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff983d25a7e600:12078] 3 exiting: rc = 0 00000100:00080000:2.0:1787360035.505839:0:5857:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787360035.506811:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff983d1240b800:6700] 1 exiting: rc = 0 00000100:00100000:3.0:1787360035.511817:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511831:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511842:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511853:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511859:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511865:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511870:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511876:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511882:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511888:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511895:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511900:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511906:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511924:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511930:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511935:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511940:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511945:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511951:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511956:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511962:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511968:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511973:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511979:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511984:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.511990:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512007:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512014:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512019:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512025:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512031:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512037:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512042:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512048:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512053:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512059:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512065:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512072:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512077:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512083:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512089:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512096:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512101:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512107:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512112:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512119:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512124:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512129:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512142:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512148:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512153:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512158:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512163:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512168:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512174:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512179:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512185:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512191:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512197:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512202:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512207:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512212:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512218:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.512227:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360035.513331:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff983d41584600:6702] 0 exiting: rc = 1 00000100:00100000:2.0:1787360035.514839:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff983d41585200:6703] 1 exiting: rc = 0 00000100:00100000:3.0:1787360035.515039:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515048:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515054:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515059:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515065:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515070:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515075:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515080:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515086:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515091:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515096:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515101:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515106:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515112:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515118:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515123:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515129:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515134:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515139:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515156:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515161:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515165:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515170:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515175:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515180:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515185:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515191:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515196:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515200:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515205:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515211:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515216:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515221:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515226:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515232:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515238:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515242:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515248:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515254:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515260:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515265:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515270:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515276:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515282:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515288:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515293:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515299:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515304:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515309:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515315:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515321:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515325:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515331:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515337:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515352:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515357:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515362:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515368:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515373:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515378:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515383:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515388:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515394:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.515400:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360035.516839:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff983d40ac7000:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1787360035.517127:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff983d40ac7c00:6706] 2 exiting: rc = 0 00000100:00100000:3.0:1787360035.517320:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff983d40ac6600:6704] 0 exiting: rc = 1 00000100:00100000:3.0:1787360035.517382:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517391:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517398:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517404:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517411:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517418:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517424:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517429:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517435:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517442:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517448:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517454:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517461:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517467:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517473:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517480:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517487:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517493:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517499:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517506:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517512:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517518:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517524:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517831:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517854:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517860:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517866:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517873:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517893:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517899:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517905:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517911:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517916:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517922:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517928:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517934:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517940:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517946:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517952:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517957:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517963:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517969:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517974:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517980:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517985:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517991:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.517997:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518003:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518009:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518014:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518021:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518028:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518048:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518055:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518062:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518068:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518075:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518082:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518089:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518102:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518109:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518116:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518122:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787360035.518128:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787360035.523628:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff983d32cd1a00:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1787360035.524056:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff983d12eaec00:6708] 1 exiting: rc = 0 00000100:00100000:0.0:1787360035.524177:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524186:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524192:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524197:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524202:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524208:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524213:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524219:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524226:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524232:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524253:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524257:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524269:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524278:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524283:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524289:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524294:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524299:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524304:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524309:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524314:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524320:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524325:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524331:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524337:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524342:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524347:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524352:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524357:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524383:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524390:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524396:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524401:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524407:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524413:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524419:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524424:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524430:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524435:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524440:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524445:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524451:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524456:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524461:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524465:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524481:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524488:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524493:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524498:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524504:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524510:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524515:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524520:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524526:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524607:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524613:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524619:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524624:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524629:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524635:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524641:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524646:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524965:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.524974:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787360035.526024:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff983d41c28a00:6709] 0 exiting: rc = 1 00000100:00100000:1.0:1787360035.526131:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff983d10478600:6710] 1 exiting: rc = 0 00000100:00100000:0.0:1787360035.526244:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526253:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526260:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526266:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526272:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526279:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526284:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526290:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526296:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526302:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526307:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526313:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526319:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526337:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526345:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526350:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526366:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526373:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526379:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526385:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526392:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526398:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526404:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526410:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526416:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526437:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526445:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526451:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526458:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526463:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526469:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526474:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526481:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526487:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526493:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526500:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526506:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526526:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526604:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526611:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526618:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526624:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526630:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526636:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526642:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526648:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526886:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526891:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526897:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526917:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526923:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526936:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526942:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526948:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526954:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526960:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526966:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526973:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526979:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.526993:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.527000:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.527006:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.527011:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787360035.527016:0:13374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787360035.535883:0:13374:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787360050.871566:0:13986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787360058.745514:0:14447:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787360058.745519:0:14447:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787360058.745633:0:14447:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff983d3f3a2800 00000020:01000004:3.0:1787360058.745648:0:14447:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787360058.745656:0:14447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787360058.745671:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff983d0860b370) 00000020:00000080:3.0:1787360058.745723:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787360058.768474:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787360058.771279:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787360058.771932:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787360058.771997:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787360058.772221:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787360058.772405:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787360058.772557:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787360058.772641:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787360058.772978:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787360058.773499:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1787360058.775069:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 486: rc = 0 00100000:10000000:3.0:1787360058.775306:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 486: rc = 0 00100000:10000000:3.0:1787360058.775943:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:3.0:1787360058.776525:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787360058.777028:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787360058.777554:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787360058.777979:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:3.0:1787360058.778470:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1787360058.778942:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1787360058.779414:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1787360058.779656:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787360058.780055:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787360058.780534:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787360058.781026:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1787360058.781671:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 660: rc = 0 00100000:10000000:3.0:1787360058.782253:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 660: rc = 0 00100000:10000000:3.0:1787360058.782600:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 660: rc = 0 00100000:10000000:3.0:1787360058.783207:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 660: rc = 0 00100000:10000000:3.0:1787360058.783554:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 660: rc = 0 00100000:10000000:3.0:1787360058.783970:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 660: rc = 0 00100000:10000000:3.0:1787360058.784452:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 660: rc = 0 00100000:10000000:3.0:1787360058.784946:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 660: rc = 0 00100000:10000000:3.0:1787360058.789458:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 660: rc = 0 00100000:10000000:3.0:1787360058.791566:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 660: rc = 0 00100000:10000000:2.0:1787360058.795133:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 660: rc = 0 00100000:10000000:2.0:1787360058.795470:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 660: rc = 0 00100000:10000000:2.0:1787360058.796555:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 660: rc = 0 00100000:10000000:2.0:1787360058.797012:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 660: rc = 0 00100000:10000000:2.0:1787360058.798262:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 660: rc = 0 00100000:10000000:2.0:1787360058.798636:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 660: rc = 0 00100000:10000000:2.0:1787360058.801047:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 660: rc = 0 00100000:10000000:2.0:1787360058.802055:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 660: rc = 0 00100000:10000000:2.0:1787360058.803984:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 660: rc = 0 00100000:10000000:2.0:1787360058.804966:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 660: rc = 0 00100000:10000000:2.0:1787360058.805586:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 660: rc = 0 00100000:10000000:2.0:1787360058.806409:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 660: rc = 0 00100000:10000000:2.0:1787360058.806659:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 660: rc = 0 00100000:10000000:2.0:1787360058.806960:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 660: rc = 0 00100000:10000000:2.0:1787360058.807231:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 660: rc = 0 00100000:10000000:2.0:1787360058.807507:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 660: rc = 0 00100000:10000000:2.0:1787360058.808332:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 660: rc = 0 00100000:10000000:2.0:1787360058.808596:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 660: rc = 0 00100000:10000000:2.0:1787360058.808922:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 660: rc = 0 00100000:10000000:2.0:1787360058.809507:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 660: rc = 0 00100000:10000000:2.0:1787360058.810149:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 660: rc = 0 00100000:10000000:2.0:1787360058.810431:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 660: rc = 0 00100000:10000000:2.0:1787360058.810829:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:2.0:1787360058.811313:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787360058.811495:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 273: rc = 0 00100000:10000000:2.0:1787360058.811711:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787360058.811782:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 273: rc = 0 00100000:10000000:2.0:1787360058.811971:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787360058.812038:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 273: rc = 0 00100000:10000000:2.0:1787360058.813470:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787360058.813559:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 487: rc = 0 00100000:10000000:2.0:1787360058.814310:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787360058.814471:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 487: rc = 0 00100000:10000000:2.0:1787360058.814670:0:14447:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787360058.816014:0:14447:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 487: rc = 0 00000020:00000080:2.0:1787360058.816903:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787360058.817036:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787360058.817049:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef46ff 00000020:01000004:2.0:1787360058.817060:0:14447:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787360058.817064:0:14447:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787360058.817070:0:14447:0:(tgt_mount.c:101:server_register_mount()) register mount ffff983d3f3a2800 from MGS 00000020:01000004:2.0:1787360058.817074:0:14447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787360058.817208:0:14447:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff983d39bf3370) 00000020:00000080:2.0:1787360058.817220:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787360058.817298:0:14447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d3f3a2800 from MGS, refs=2 00080000:01000000:2.0:1787360058.817304:0:14447:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787360058.817310:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef470d 00000100:00100000:2.0:1787360058.817494:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787360058.817640:0:14447:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787360058.817648:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787360058.819248:0:14447:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787360058.819279:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787360058.820445:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360058.820638:0:14447:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787360058.820645:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787360058.822415:0:14447:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787360058.822427:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787360058.823238:0:14447:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787360058.823247:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787360058.824425:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360058.824430:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360058.824432:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360058.825043:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360058.825046:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360058.825048:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360058.826028:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787360058.830293:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787360058.856648:0:14447:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787360058.856670:0:14447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787360058.856674:0:14447:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787360058.870391:0:14456:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787360058.871784:0:14447:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787360058.871925:0:14447:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787360058.872475:0:14447:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787360058.872821:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360058.873011:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787360058.873017:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787360058.877322:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787360058.877339:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787360058.878283:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787360058.878291:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787360058.880395:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787360058.880422:0:14447:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.114@tcp' 00000020:01000004:1.0:1787360058.880423:0:14447:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787360058.880457:0:14447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.114@tcp (typ=mgc) 00000020:00000080:1.0:1787360058.880473:0:14447:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.114@tcp (ffff983d3f650000) 00000020:00000080:1.0:1787360058.880489:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787360058.880578:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d1dc43800@MGC192.168.201.114@tcp: add connection 192.168.201.114@tcp at head 00010000:00010000:1.0:1787360058.880776:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.114@tcp-0 is initialized 00000040:01000000:1.0:1787360058.880782:0:14447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787360058.881244:0:14461:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787360058.881497:0:14462:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787360058.881554:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.114@tcp (uuid f3bf1097-deff-4714-8b83-3baf6c1a0ca6) 00000020:00000080:3.0:1787360058.881573:0:14447:0:(genops.c:1385:class_connect()) connect: client f3bf1097-deff-4714-8b83-3baf6c1a0ca6, cookie 0x72f6de40e4ef471b 00000100:00080000:3.0:1787360058.881585:0:14447:0:(import.c:510:import_select_connection()) MGC192.168.201.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787360058.881592:0:14447:0:(import.c:624:import_select_connection()) MGC192.168.201.114@tcp: import ffff983d1dc43800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:3.0:1787360058.881634:0:14447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f8cce00 x1874182527865216/t0(0) o250->MGC192.168.201.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787360058.881663:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f3bf1097-deff-4714-8b83-3baf6c1a0ca6->MGS 00000020:01000004:3.0:1787360058.881702:0:14447:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787360058.881708:0:14447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787360058.881719:0:14447:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff983d0860cd28) 00000020:00000080:3.0:1787360058.881728:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787360058.881867:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3316:1874182527865216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787360058.881953:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360058.882031:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865216 00000100:00100000:0.0:1787360058.882040:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865216 00000100:00100000:0.0:1787360058.882075:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360058.882084:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1874182527865216:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787360058.882112:0:14458:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f3bf1097-deff-4714-8b83-3baf6c1a0ca6@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1787360058.882135:0:14458:0:(genops.c:1385:class_connect()) connect: client f3bf1097-deff-4714-8b83-3baf6c1a0ca6, cookie 0x72f6de40e4ef4729 00000100:00080000:0.0:1787360058.882256:0:14458:0:(import.c:65:import_set_state_nolock()) ffff983d3f1b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360058.882326:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+5:3316:x1874182527865216:12345-0@lo:250:mount.lustre.0 Request processed in 241us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360058.882334:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360058.882386:0:3316:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787360058.882396:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.114@tcp: connect to target with instance 0 00000100:00080000:0.0:1787360058.882404:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787360058.882408:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787360058.882420:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d1dc43800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787360058.882422:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787360058.882430:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787360058.882436:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3316:1874182527865216:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787360058.908832:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360058.909042:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787360058.909048:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787360058.913561:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787360058.914294:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787360058.915639:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787360058.915652:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787360058.916456:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787360058.916651:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787360058.916657:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787360058.919877:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787360058.919898:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787360059.000661:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360059.001456:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787360059.001465:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787360059.003206:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787360059.003215:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787360059.004230:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360059.004444:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787360059.004448:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787360059.004816:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787360059.004823:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787360059.005427:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360059.005542:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787360059.005545:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787360059.006062:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787360059.006067:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787360059.008162:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360059.008364:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787360059.008370:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787360059.008948:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787360059.008954:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787360059.048295:0:14447:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360059.048517:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787360059.048524:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787360059.049894:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787360059.049906:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787360059.052657:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787360059.052672:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787360059.053554:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787360059.053579:0:14447:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787360059.053586:0:14447:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787360059.053909:0:14447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787360059.053944:0:14447:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.114@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787360059.053949:0:14447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787360059.053950:0:14447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787360059.053952:0:14447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360059.053953:0:14447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360059.053954:0:14447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360059.053956:0:14447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360059.053957:0:14447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360059.053959:0:14447:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787360059.053961:0:14447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360059.053962:0:14447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360059.053964:0:14447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787360059.053966:0:14447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787360059.053972:0:14447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787360059.053973:0:14447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360059.053974:0:14447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360059.053975:0:14447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360059.053976:0:14447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360059.053977:0:14447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360059.053978:0:14447:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787360059.053978:0:14447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360059.053979:0:14447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787360059.054011:0:14447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787360059.054032:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787360059.054104:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.054199:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d02ae9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360059.054255:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865344 00000100:00100000:3.0:1787360059.054274:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865344 00000100:00100000:3.0:1787360059.054362:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360059.054373:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+5:14447:x1874182527865344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360059.054425:0:14460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787360059.054429:0:14460:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787360059.054432:0:14460:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787360059.054784:0:14481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787360059.055355:0:14460:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787360059.056667:0:14482:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787360059.056952:0:14482:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787360059.056958:0:14482:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787360059.057001:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787360059.057301:0:14460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787360059.057311:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787360059.075539:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+5:14447:x1874182527865344:12345-0@lo:253:mount.lustre.0 Request processed in 21151us (21417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.075554:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360059.076045:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787360059.076070:0:14447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787360059.076073:0:14447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787360059.076075:0:14447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787360059.076077:0:14447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360059.076078:0:14447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360059.076080:0:14447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360059.076082:0:14447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360059.076083:0:14447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787360059.076085:0:14447:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787360059.076087:0:14447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360059.076088:0:14447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787360059.076114:0:14447:0:(tgt_mount.c:101:server_register_mount()) register mount ffff983d3f3a2800 from lustre-MDT0000 10000000:01000000:2.0:1787360059.076140:0:14447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787360059.076143:0:14447:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787360059.076147:0:14447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff983d3f650000 10000000:01000000:2.0:1787360059.076151:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360059.076159:0:14447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff983d3f650000 from 1 10000000:01000000:2.0:1787360059.076162:0:14447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787360059.076216:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.076227:0:14447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.076238:0:14447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.076258:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360059.076313:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360059.076406:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865472 00000100:00100000:0.0:1787360059.076414:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865472 00000100:00100000:2.0:1787360059.076416:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360059.076473:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360059.076485:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+5:14447:x1874182527865472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360059.076499:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360059.076516:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41000/0x72f6de40e4ef4737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4730 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.076543:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41000/0x72f6de40e4ef4737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4730 expref: 6 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.076553:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41000/0x72f6de40e4ef4737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4730 expref: 6 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.076562:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41000, rc 0) 00000100:00100000:0.0:1787360059.076606:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+6:14447:x1874182527865472:12345-0@lo:101:mount.lustre.0 Request processed in 124us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.076612:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787360059.076870:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360059.076885:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.076964:0:14447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360059.080632:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360059.080771:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.080984:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0dd55c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360059.081164:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865600 00000100:00100000:0.0:1787360059.081175:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865600 00000100:00100000:0.0:1787360059.081240:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360059.081252:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+6:14447:x1874182527865600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360059.082315:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+6:14447:x1874182527865600:12345-0@lo:501:mount.lustre.0 Request processed in 1060us (1539us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787360059.082333:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360059.082473:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865600:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787360059.082516:0:14447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787360059.082646:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.082660:0:14447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360059.082670:0:14447:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff983d3f3a2800 10000000:01000000:3.0:1787360059.082703:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787360059.082708:0:14447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff983d3f3a2800 10000000:01000000:3.0:1787360059.082712:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787360059.082726:0:14447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff983d3f3a2800 from 1 10000000:01000000:3.0:1787360059.082729:0:14447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787360059.082781:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.082789:0:14447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.083059:0:14447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360059.083081:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360059.083123:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.083162:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d0dd55c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.083293:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865728 00000100:00100000:1.0:1787360059.083301:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865728 00000100:00100000:1.0:1787360059.083350:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360059.083427:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+6:14447:x1874182527865728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360059.083440:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360059.083458:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c3800/0x72f6de40e4ef4745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef473e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.083499:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c3800/0x72f6de40e4ef4745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef473e expref: 7 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.083511:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c3800/0x72f6de40e4ef4745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef473e expref: 7 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.083522:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3800, rc 0) 00000100:00100000:1.0:1787360059.085927:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+7:14447:x1874182527865728:12345-0@lo:101:mount.lustre.0 Request processed in 2492us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.085939:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360059.086072:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360059.086100:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4745 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.086114:0:14447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4745 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360059.086136:0:14447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787360059.089202:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4745 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.089257:0:14447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b63000/0x72f6de40e4ef473e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4745 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360059.089277:0:14447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787360059.089285:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360059.089293:0:14447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff983d3f3a2800 10000000:01000000:2.0:1787360059.089298:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787360059.089302:0:14447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787360059.089306:0:14447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787360059.089349:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.089364:0:14447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.089377:0:14447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.089403:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360059.089478:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.089516:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.089771:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865856 00000100:00100000:1.0:1787360059.089781:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865856 00000100:00100000:1.0:1787360059.089844:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360059.089853:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+7:14447:x1874182527865856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360059.089866:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360059.089878:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c2600/0x72f6de40e4ef4753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef474c expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.089904:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2600/0x72f6de40e4ef4753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef474c expref: 8 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.089915:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c2600/0x72f6de40e4ef4753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef474c expref: 8 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.089925:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2600, rc 0) 00000100:00100000:1.0:1787360059.089969:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+8:14447:x1874182527865856:12345-0@lo:101:mount.lustre.0 Request processed in 116us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.089977:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360059.090212:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360059.090224:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4753 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.090231:0:14447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4753 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.090324:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.090365:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.090451:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360059.090650:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527865984 00000100:00100000:3.0:1787360059.090656:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527865984 00000100:00100000:3.0:1787360059.090955:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360059.090966:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+8:14447:x1874182527865984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360059.091553:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14447:x1874182527865984:12345-0@lo:501:mount.lustre.0 Request processed in 587us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.091561:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787360059.091703:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527865984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.091869:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527866112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360059.092007:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.092093:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787360059.092142:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527866112 00000100:00100000:0.0:1787360059.092156:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527866112 00000100:00100000:0.0:1787360059.092243:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787360059.092252:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14447:x1874182527866112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360059.092778:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14447:x1874182527866112:12345-0@lo:503:mount.lustre.0 Request processed in 525us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.092786:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360059.092968:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527866112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360059.093719:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14483:1874182527866240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360059.093786:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.094135:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d014ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.094221:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527866240 00000100:00100000:1.0:1787360059.094228:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527866240 00000100:00100000:1.0:1787360059.094278:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787360059.094288:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14483:x1874182527866240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360059.094905:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14483:x1874182527866240:12345-0@lo:502:llog_process_th.0 Request processed in 617us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.094913:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360059.095187:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14483:1874182527866240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787360059.095221:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360059.095232:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.095234:0:14483:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787360059.095249:0:14483:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787360059.095252:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787360059.095276:0:14483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff983d08608000) 00000020:00000080:3.0:1787360059.095295:0:14483:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787360059.095301:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787360059.095460:0:14483:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787360059.095468:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef4761 00000020:00000080:3.0:1787360059.096177:0:14483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787360059.096183:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360059.096186:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.096187:0:14483:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787360059.096189:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360059.096192:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.096193:0:14483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787360059.096195:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787360059.096202:0:14483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff983d086099b8) 00000020:00000080:3.0:1787360059.096210:0:14483:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787360059.096213:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787360059.096214:0:14483:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787360059.096215:0:14483:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787360059.096219:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787360059.096249:0:14483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d3f3a2800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787360059.096278:0:14483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff983d39ddb370) 00000020:00000080:3.0:1787360059.096288:0:14483:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787360059.096344:0:14483:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787360059.096349:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef4776 00000020:00000080:3.0:1787360059.096509:0:14483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787360059.096517:0:14483:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787360059.096522:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x72f6de40e4ef477d 00080000:01000000:3.0:1787360059.096527:0:14483:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787360059.096590:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef4784 00010000:00010000:0.0:1787360059.257778:0:14483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787360059.258294:0:14483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787360059.263044:0:14483:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787360059.264076:0:14483:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff983d3f6519b8) 00000020:00000080:1.0:1787360059.264098:0:14483:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787360059.264167:0:14483:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787360059.264175:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef4792 00000020:00000080:3.0:1787360059.266880:0:14483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787360059.283290:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x72f6de40e4ef4799 00000020:00000080:0.0:1787360059.286307:0:14483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787360059.286324:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360059.286333:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.286336:0:14483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787360059.286340:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787360059.286346:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.286347:0:14483:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787360059.286351:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787360059.286416:0:14483:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787360059.286435:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360059.286438:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.286440:0:14483:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787360059.286442:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360059.286444:0:14483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1787360059.286446:0:14483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360059.286447:0:14483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360059.286449:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360059.286451:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.286452:0:14483:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360059.286455:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360059.286458:0:14483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787360059.286461:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.286472:0:14483:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787360059.286477:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360059.286482:0:14483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.114@tcp to nid 0x20000c0a8c972 (192.168.201.114@tcp) 00000020:01000000:0.0:1787360059.286509:0:14483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787360059.286513:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360059.286532:0:14483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff983d11010000) 00000020:00000080:0.0:1787360059.286550:0:14483:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787360059.286556:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787360059.286625:0:14483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787360059.286631:0:14483:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787360059.286639:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef47a7 00010000:00080000:0.0:1787360059.286716:0:14483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d275f2000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.114@tcp at head 00010000:00010000:0.0:1787360059.287815:0:14483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787360059.289583:0:14483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360059.290150:0:14483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787360059.297025:0:14483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360059.297092:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787360059.297159:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787360059.305222:0:14487:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787360059.305230:0:14487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787360059.305928:0:14483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787360059.305940:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787360059.305974:0:14483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787360059.305994:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef47ae 00000100:00080000:0.0:1787360059.306007:0:14483:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360059.306013:0:14483:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff983d275f2000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787360059.306056:0:14483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d40994700 x1874182527866368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360059.307893:0:14483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787360059.308037:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787360059.308045:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.308047:0:14483:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787360059.308066:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787360059.308070:0:14483:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787360059.308072:0:14483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360059.308073:0:14483:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787360059.308075:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787360059.308078:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.308080:0:14483:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787360059.308083:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787360059.308093:0:14483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787360059.308097:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787360059.308099:0:14483:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787360059.308102:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787360059.308106:0:14483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.114@tcp to nid 0x20000c0a8c972 (192.168.201.114@tcp) 00000020:01000000:0.0:1787360059.308130:0:14483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787360059.308134:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787360059.308150:0:14483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff983d11014d28) 00000020:00000080:0.0:1787360059.308168:0:14483:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787360059.308173:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787360059.308242:0:14483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787360059.308248:0:14483:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787360059.308254:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x72f6de40e4ef47bc 00010000:00080000:0.0:1787360059.308310:0:14483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d11452800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.114@tcp at head 00000100:00100000:2.0:1787360059.308524:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527866368:0@lo:8:llog_process_th.0 00010000:00010000:0.0:1787360059.308539:0:14483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000400:00000100:2.0:1787360059.308606:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182527866368 offset 0 length 520: 4 00000040:01000000:0.0:1787360059.314510:0:14483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787360059.314544:0:14483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787360059.315132:0:14483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360059.315204:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787360059.315294:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787360059.316138:0:14489:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787360059.316145:0:14489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787360059.317302:0:14483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787360059.317317:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787360059.320018:0:14483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787360059.320063:0:14483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef47c3 00000100:00080000:1.0:1787360059.320078:0:14483:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360059.320085:0:14483:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff983d11452800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360059.320136:0:14483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98c000 x1874182527866496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360059.320170:0:14483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787360059.320276:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360059.320282:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360059.320285:0:14483:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787360059.320288:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360059.320293:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360059.320295:0:14483:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787360059.320315:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787360059.320318:0:14483:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787360059.320321:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360059.320323:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360059.320325:0:14483:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787360059.320327:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787360059.320330:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360059.320331:0:14483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787360059.320334:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787360059.320340:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527866496:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787360059.320370:0:14483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14483:1874182527866624:0@lo:502:llog_process_th.0 00000400:00000100:2.0:1787360059.320405:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182527866496 offset 0 length 520: 4 00000100:00100000:1.0:1787360059.320436:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360059.320469:0:14483:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12f2a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360059.320505:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527866624 00000100:00100000:3.0:1787360059.320519:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527866624 00000100:00100000:3.0:1787360059.320573:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360059.320583:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14483:x1874182527866624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360059.320870:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14483:x1874182527866624:12345-0@lo:502:llog_process_th.0 Request processed in 287us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.320879:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787360059.325018:0:14483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14483:1874182527866624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787360059.325080:0:14483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787360059.325092:0:14483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787360059.325094:0:14483:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787360059.325100:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787360059.325543:0:14447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787360059.325573:0:14447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787360059.325643:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4753 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.325655:0:14447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05347a00/0x72f6de40e4ef474c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4753 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360059.325663:0:14447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d3f3a2800 from 1 10000000:01000000:2.0:1787360059.325666:0:14447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360059.325731:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.325752:0:14447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.325763:0:14447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.325792:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527866752:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360059.325864:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.325917:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.325995:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527866752 00000100:00100000:1.0:1787360059.326003:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527866752 00000100:00100000:1.0:1787360059.326058:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360059.326069:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+9:14447:x1874182527866752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360059.326083:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360059.326098:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef47ca expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.326124:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.326135:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.326156:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2200, rc 0) 00000100:00100000:1.0:1787360059.326205:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+10:14447:x1874182527866752:12345-0@lo:101:mount.lustre.0 Request processed in 137us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.326213:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787360059.330844:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527866752:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360059.330880:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.330894:0:14447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.331577:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527866880:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787360059.331652:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.331823:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.335169:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527866880 00000100:00100000:1.0:1787360059.335188:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527866880 00000100:00100000:1.0:1787360059.335253:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787360059.335275:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+10:14447:x1874182527866880:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787360059.335308:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787360059.335315:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787360059.335443:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+10:14447:x1874182527866880:12345-0@lo:256:mount.lustre.0 Request processed in 180us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.335451:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360059.335853:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527866880:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787360059.336469:0:14447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787360059.336498:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.336512:0:14447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360059.336536:0:14447:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d3f3a2800 from 1 10000000:01000000:2.0:1787360059.336540:0:14447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360059.336582:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.336591:0:14447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.336602:0:14447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.336623:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360059.336674:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.336762:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.337850:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867008 00000100:00100000:1.0:1787360059.337862:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867008 00000100:00100000:1.0:1787360059.337921:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787360059.337933:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+10:14447:x1874182527867008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360059.337950:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360059.337971:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef47d8 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.338014:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.338025:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360059.338052:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c3600, rc 0) 00000100:00100000:1.0:1787360059.338120:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527867008:12345-0@lo:101:mount.lustre.0 Request processed in 189us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.338331:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360059.338588:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360059.338606:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.338615:0:14447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.338729:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.338762:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.338792:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.339083:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867136 00000100:00100000:1.0:1787360059.339088:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867136 00000100:00100000:1.0:1787360059.339112:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360059.339119:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527867136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.340633:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527867136:12345-0@lo:501:mount.lustre.0 Request processed in 1508us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360059.340645:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787360059.344064:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.347062:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360059.347161:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.347212:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88540 going to sleep for 11 seconds 00000100:00100000:1.0:1787360059.347340:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867264 00000100:00100000:1.0:1787360059.347349:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867264 00000100:00100000:1.0:1787360059.347415:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360059.347426:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527867264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360059.347651:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527867264:12345-0@lo:503:mount.lustre.0 Request processed in 225us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360059.347661:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360059.348099:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360059.349092:0:14491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14491:1874182527867392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787360059.349230:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360059.349280:0:14491:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12f2a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787360059.349340:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867392 00000100:00100000:2.0:1787360059.349348:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867392 00000100:00100000:2.0:1787360059.349394:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360059.349405:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14491:x1874182527867392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360059.349672:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14491:x1874182527867392:12345-0@lo:502:llog_process_th.0 Request processed in 268us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.349768:0:14491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14491:1874182527867392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787360059.349802:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360059.349813:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.349816:0:14491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787360059.349825:0:14491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d3f3a2800 00000020:00000080:3.0:1787360059.349828:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360059.349849:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360059.349853:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.349854:0:14491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787360059.349857:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360059.349859:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.349861:0:14491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787360059.349864:0:14491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d3f3a2800 00000020:00000080:3.0:1787360059.349866:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787360059.349888:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:3.0:1787360059.352309:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360059.352319:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.352321:0:14491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787360059.352327:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360059.352331:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.352332:0:14491:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787360059.352338:0:14491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff983d3f3a2800 00000020:00000080:3.0:1787360059.352340:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787360059.352440:0:14491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14491:1874182527867520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787360059.352540:0:14491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.352586:0:14491:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d201e83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360059.352808:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867520 00000100:00100000:0.0:1787360059.352824:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867520 00000100:00100000:0.0:1787360059.352910:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787360059.352923:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14491:x1874182527867520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360059.353183:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14491:x1874182527867520:12345-0@lo:502:llog_process_th.0 Request processed in 262us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.353193:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787360059.353498:0:14491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14491:1874182527867520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787360059.353533:0:14491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360059.353540:0:14491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360059.353542:0:14491:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787360059.353547:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787360059.353853:0:14447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787360059.353873:0:14447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360059.353897:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.353909:0:14447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360059.353955:0:14447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787360059.353958:0:14447:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff983d3f3a2800 10000000:01000000:2.0:1787360059.353961:0:14447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff983d3f3a2800 10000000:01000000:2.0:1787360059.353967:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360059.353973:0:14447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d3f3a2800 from 1 10000000:01000000:2.0:1787360059.353976:0:14447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787360059.354008:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.354017:0:14447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.354034:0:14447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.354052:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360059.354092:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.354210:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867648 00000100:00100000:3.0:1787360059.354215:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867648 00000100:00100000:3.0:1787360059.354252:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787360059.354271:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527867648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360059.354281:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360059.354298:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62800/0x72f6de40e4ef47ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef47e6 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.354338:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62800/0x72f6de40e4ef47ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef47e6 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.354351:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62800/0x72f6de40e4ef47ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef47e6 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.354372:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62800, rc 0) 00000100:00100000:3.0:1787360059.354409:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14447:x1874182527867648:12345-0@lo:101:mount.lustre.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360059.354416:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787360059.354540:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360059.354558:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360059.354571:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47ed expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360059.354580:0:14447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef47ed expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.354632:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.354658:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360059.355218:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867776 00000100:00100000:0.0:1787360059.355224:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867776 00000100:00100000:0.0:1787360059.355274:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360059.355283:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14447:x1874182527867776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360059.355523:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14447:x1874182527867776:12345-0@lo:501:mount.lustre.0 Request processed in 241us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.355531:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787360059.355603:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360059.355618:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360059.355656:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360059.356227:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.356274:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360059.356299:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527867904 00000100:00100000:2.0:1787360059.356304:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527867904 00000100:00100000:2.0:1787360059.356339:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360059.356348:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14447:x1874182527867904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360059.356526:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14447:x1874182527867904:12345-0@lo:503:mount.lustre.0 Request processed in 179us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360059.356542:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360059.356599:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527867904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360059.370973:0:14493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14493:1874182527868032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360059.371058:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360059.371100:0:14493:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12ef6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787360059.371360:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868032 00000100:00100000:2.0:1787360059.371370:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868032 00000100:00100000:2.0:1787360059.371435:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787360059.371449:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14493:x1874182527868032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360059.371785:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14493:x1874182527868032:12345-0@lo:502:llog_process_th.0 Request processed in 340us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360059.371794:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787360059.371865:0:14493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40996a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14493:1874182527868032:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787360059.371931:0:14493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787360059.371946:0:14493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff983d39bf4d28) 00000020:00000080:2.0:1787360059.371964:0:14493:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787360059.372034:0:14493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d3f3a2800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787360059.372038:0:14493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d3f3a2800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787360059.372041:0:14493:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d3f3a2800 4 00010000:00080000:2.0:1787360059.372072:0:14493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d41568000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.114@tcp at head 00010000:00010000:2.0:1787360059.373841:0:14493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787360059.374036:0:14493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787360059.374067:0:14493:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787360059.374077:0:14493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x72f6de40e4ef47fb 00000100:00080000:2.0:1787360059.374087:0:14493:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787360059.374092:0:14493:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff983d41568000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:2.0:1787360059.374131:0:14493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d1e175f80 x1874182527868160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787360059.374152:0:14493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787360059.376603:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527868160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360059.376720:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.376787:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868160 00000100:00100000:3.0:1787360059.376798:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868160 00000100:00100000:3.0:1787360059.377232:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360059.377242:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874182527868160:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787360059.377335:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1874182527868160:12345-0@lo:38:llog_process_th.0 Request processed in 91us (614us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787360059.377350:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360059.377520:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360059.377531:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d41568000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360059.377536:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787360059.377540:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527868160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360059.381610:0:14493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14493:1874182527868288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787360059.381720:0:14493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360059.381763:0:14493:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787360059.382006:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868288 00000100:00100000:0.0:1787360059.382017:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868288 00000100:00100000:0.0:1787360059.382078:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787360059.382089:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14493:x1874182527868288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787360059.382378:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14493:x1874182527868288:12345-0@lo:502:llog_process_th.0 Request processed in 289us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.382387:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787360059.382873:0:14493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14493:1874182527868288:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787360059.382903:0:14493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787360059.383039:0:14447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787360059.383067:0:14447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787360059.383091:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47ed expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.383101:0:14447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05346e00/0x72f6de40e4ef47e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef47ed expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787360059.383242:0:14447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787360059.383244:0:14447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360059.383245:0:14447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360059.383247:0:14447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360059.383248:0:14447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360059.383250:0:14447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360059.383251:0:14447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360059.383252:0:14447:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360059.383254:0:14447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360059.383255:0:14447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787360059.383267:0:14447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787360059.383270:0:14447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787360059.383271:0:14447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360059.383272:0:14447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360059.383273:0:14447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360059.383274:0:14447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360059.383275:0:14447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360059.383276:0:14447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360059.383277:0:14447:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360059.383278:0:14447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360059.383279:0:14447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787360059.383299:0:14447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787360059.383315:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527868416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787360059.383366:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360059.383437:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12ef6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787360059.387958:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868416 00000100:00100000:3.0:1787360059.387976:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868416 00000100:00100000:3.0:1787360059.388036:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787360059.388049:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14447:x1874182527868416:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360059.388094:0:14458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787360059.388111:0:14458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787360059.457742:0:14458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787360059.457769:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787360059.457812:0:14481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787360059.457818:0:14481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787360059.457847:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.457869:0:14481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.457878:0:14481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.457936:0:14481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.457955:0:14481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 12 pid: 14459 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360059.457989:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14481:1874182527868544:0@lo:104: 00000100:00100000:3.0:1787360059.458062:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360059.458277:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d012ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1787360059.458618:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868544 00000100:00100000:0.0:1787360059.458629:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868544 00000100:00100000:0.0:1787360059.458705:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360059.458717:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14481:x1874182527868544:12345-0@lo:104: 00010000:00010000:0.0:1787360059.458742:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.458840:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360059.458849:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14481:x1874182527868544:12345-0@lo:104: Request processed in 132us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.458858:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787360059.458885:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14481:1874182527868544:0@lo:104: 00010000:00010000:0.0:1787360059.458887:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360059.458898:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.458906:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360059.458911:0:14454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.458913:0:14481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.458926:0:14454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360059.458936:0:14454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360059.458943:0:14454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360059.458986:0:14454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.458993:0:14454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360059.459015:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459022:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d05347000/0x72f6de40e4ef47ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef47d1 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459046:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360059.459048:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360059.459050:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360059.459074:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527868672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360059.459107:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360059.459340:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868672 00000100:00100000:0.0:1787360059.459345:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868672 00010000:00010000:0.0:1787360059.459365:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 13 pid: 14459 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360059.459389:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360059.459398:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+13:3317:x1874182527868672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360059.459409:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360059.459416:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 13 pid: 14459 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459428:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 13 pid: 14459 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459441:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c2200/0x72f6de40e4ef47d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef47ca expref: 13 pid: 14459 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459459:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459468:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787360059.459484:0:14450:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001666449s 00010000:00010000:0.0:1787360059.459494:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459501:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459508:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459515:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459520:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360059.459525:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459533:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459556:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360059.459566:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360059.459599:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3317:x1874182527868672:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360059.459606:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360059.459638:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527868672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360059.460069:0:14481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.460079:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360059.460087:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef4802 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360059.469588:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14447:x1874182527868416:12345-0@lo:253:mount.lustre.0 Request processed in 81532us (86211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360059.469604:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787360059.469962:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14447:1874182527868416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360059.469982:0:14447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787360059.469985:0:14447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360059.470002:0:14447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787360059.470004:0:14447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360059.470005:0:14447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360059.470006:0:14447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360059.470007:0:14447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360059.470008:0:14447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787360059.470010:0:14447:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787360059.470012:0:14447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360059.470013:0:14447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787360059.470031:0:14447:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787360059.480420:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787360059.480825:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787360059.481106:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787360059.481243:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787360059.481525:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787360059.481725:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787360059.482802:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787360059.482950:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787360059.483255:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787360059.483490:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787360059.484429:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787360059.484591:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787360059.506792:0:14447:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787360059.507747:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787360059.509346:0:14504:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787360059.509487:0:14504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360059.511526:0:14504:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787360059.511619:0:14504:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787360059.511623:0:14504:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1787360059.513515:0:14503:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787360059.513522:0:14503:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787360059.518372:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787360059.518509:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787360059.518957:0:14447:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787360059.518966:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787360059.519099:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787360059.521475:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787360059.522019:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787360059.522052:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787360059.523314:0:14447:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787360059.533574:0:14447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787360059.583999:0:14447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787360059.584039:0:14447:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdef80d87988 00100000:10000000:3.0:1787360059.584048:0:14447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787360059.585348:0:14447:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787360059.585363:0:14447:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787360059.585387:0:14447:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787360059.585413:0:14447:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787360059.879618:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360060.392592:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787360060.520641:0:14462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787360060.520650:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d3f3a2800 from 6 10000000:01000000:2.0:1787360060.520657:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360060.520751:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.520764:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.520778:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360060.520821:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527868800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.520901:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360060.520949:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d02ae9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.520980:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868800 00000100:00100000:2.0:1787360060.520989:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868800 00000100:00100000:2.0:1787360060.521041:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360060.521051:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14462:x1874182527868800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360060.521064:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360060.521079:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4809 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.521106:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.521116:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.521127:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346600, rc 0) 00000100:00100000:2.0:1787360060.521170:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527868800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.521178:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360060.521233:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527868800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360060.521261:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.521272:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360060.521328:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527868928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787360060.521358:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360060.521374:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d02ae9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360060.521393:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527868928 00000100:00100000:2.0:1787360060.521398:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527868928 00000100:00100000:2.0:1787360060.521420:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360060.521427:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527868928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787360060.521442:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787360060.521459:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787360060.521463:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787360060.521545:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527868928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360060.521552:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787360060.521584:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527868928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787360060.521626:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787360060.521633:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360060.521641:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360060.905286:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787360061.416208:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787360061.928321:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360062.950886:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360063.974873:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787360064.053207:0:14746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787360064.423145:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360064.423153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360064.423156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360064.423159:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360064.423162:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787360064.423165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787360064.423169:0:36:0:(import.c:65:import_set_state_nolock()) ffff983d41568000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360064.423192:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff983d41568000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360064.423219:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98d880 x1874182527869184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787360064.423270:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527869184:0@lo:38:kworker.0 00000100:00100000:1.0:1787360064.423343:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360064.423634:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3318:1874182527869056:0@lo:400:kworker.0 00000100:00100000:0.0:1787360064.423701:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360064.424091:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869184 00000100:00100000:2.0:1787360064.424102:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869184 00000100:00100000:2.0:1787360064.424148:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360064.424157:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1874182527869184:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787360064.424197:0:14467:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1787360064.424237:0:14467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x72f6de40e4ef4817 00000004:00100000:2.0:1787360064.424253:0:14467:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787360064.424392:0:14467:0:(import.c:65:import_set_state_nolock()) ffff983d054d9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360064.424522:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874182527869184:12345-0@lo:38:kworker.0 Request processed in 364us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360064.424542:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360064.424570:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869056 00000100:00100000:2.0:1787360064.424574:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869056 00000100:00100000:2.0:1787360064.424609:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360064.424616:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2757a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3318:x1874182527869056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360064.424659:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2757a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3318:x1874182527869056:12345-0@lo:400:kworker.0 Request processed in 43us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360064.424665:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787360064.424763:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3318:1874182527869056:0@lo:400:kworker.0 00010000:00080000:1.0:1787360064.429210:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d3f98d880 x1874182527869184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787360064.429238:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787360064.429250:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787360064.429257:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787360064.429262:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d41568000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787360064.429272:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874182527869184:0@lo:38:kworker.0 00010000:00010000:1.0:1787360064.999269:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360066.025487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360067.058630:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787360067.119478:0:14897:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8cca26e0 20000000:00000080:3.0:1787360067.119497:0:14897:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983d411b4000 uarg=0000000000000000 20000000:01000000:3.0:1787360067.119809:0:14897:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787360067.119818:0:14897:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787360067.119824:0:14897:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787360067.120768:0:14898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787360067.121355:0:14897:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787360067.133498:0:14897:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787360067.133533:0:14897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.133557:0:14897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.133566:0:14897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.134154:0:14897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.134172:0:14897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 11 pid: 14459 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360067.134189:0:14897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14897:1874182527869312:0@lo:104: 00000100:00100000:3.0:1787360067.134262:0:14897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360067.134336:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869312 00000100:00100000:3.0:1787360067.134345:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869312 00000100:00100000:3.0:1787360067.134402:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360067.134429:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14897:x1874182527869312:12345-0@lo:104: 00010000:00010000:3.0:1787360067.134443:0:14449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.134505:0:14449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787360067.134512:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14897:x1874182527869312:12345-0@lo:104: Request processed in 86us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360067.134520:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787360067.134582:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360067.134590:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360067.134598:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360067.134602:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360067.134617:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360067.134624:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360067.134629:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360067.134667:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360067.134674:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360067.134725:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360067.134733:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d05346400/0x72f6de40e4ef47d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef47df expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360067.134751:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360067.134753:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360067.134755:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360067.134790:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527869440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360067.134824:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360067.134873:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869440 00000100:00100000:0.0:1787360067.134877:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869440 00010000:00010000:0.0:1787360067.135385:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 12 pid: 14459 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360067.135627:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787360067.135639:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3319:x1874182527869440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360067.135654:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360067.135661:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 12 pid: 14459 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135717:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 12 pid: 14459 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135741:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135750:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135766:0:14451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135774:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135781:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135788:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135793:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360067.135798:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135823:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135833:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360067.135845:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360067.135904:0:14897:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360067.135911:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3319:x1874182527869440:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360067.135920:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360067.136342:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527869440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360067.136973:0:14897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c3600/0x72f6de40e4ef47df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef47d8 expref: 11 pid: 14459 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360067.136988:0:14897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14897:1874182527869312:0@lo:104: 00010000:00010000:3.0:1787360067.137149:0:14897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.137160:0:14897:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.137166:0:14897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360067.137171:0:14897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62000/0x72f6de40e4ef481e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.076568:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787360068.526001:0:14462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787360068.526009:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d3f3a2800 from 10 10000000:01000000:3.0:1787360068.526016:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360068.526079:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360068.526120:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360068.526133:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360068.526162:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527869568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360068.526239:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360068.526310:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d02ae9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360068.526400:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869568 00000100:00100000:0.0:1787360068.526410:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869568 00000100:00100000:0.0:1787360068.526475:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787360068.526488:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+11:14462:x1874182527869568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360068.526503:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360068.526518:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4825 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.526548:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.526560:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360068.526572:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41200, rc 0) 00000100:00100000:0.0:1787360068.526619:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527869568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.526626:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787360068.526830:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527869568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360068.526847:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360068.526857:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360068.526921:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527869696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360068.526949:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360068.526981:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d02ae9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360068.527036:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869696 00000100:00100000:0.0:1787360068.527041:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869696 00000100:00100000:0.0:1787360068.527075:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787360068.527083:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527869696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787360068.527350:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527869696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360068.527357:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787360068.527439:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527869696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787360068.527470:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527869824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360068.527508:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360068.527532:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d02ae9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360068.527545:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869824 00000100:00100000:3.0:1787360068.527549:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869824 00000100:00100000:3.0:1787360068.527583:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787360068.527589:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527869824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360068.527777:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:14462:x1874182527869824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360068.527784:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787360068.527822:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527869824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787360068.528431:0:14959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787360068.528483:0:14462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787360068.528505:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787360068.528516:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360068.528526:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360069.094931:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360069.545080:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360059/real 1787360059] req@ffff983d3f98c000 x1874182527866496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360069 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360069.545120:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff983d3f98c000 x1874182527866496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360069 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360069.545131:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360059/real 1787360059] req@ffff983d40994700 x1874182527866368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360069 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360069.545141:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff983d40994700 x1874182527866368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360069 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360069.545194:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360069.545204:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787360069.545207:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527866496:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787360069.545212:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d275f2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360069.545217:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787360069.545219:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527866368:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787360069.546266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360069.546271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787360069.546275:0:36:0:(import.c:65:import_set_state_nolock()) ffff983d275f2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360069.546281:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1787360069.546287:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787360069.546294:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff983d275f2000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360069.546320:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98f100 x1874182527870080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787360069.546334:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360069.546337:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787360069.546339:0:36:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787360069.546440:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527869952:0@lo:400:kworker.0 00000100:00100000:0.0:1787360069.546517:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787360069.546624:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1787360069.546628:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787360069.546632:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff983d11452800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360069.546647:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98f800 x1874182527870208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360069.547132:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527870080:0@lo:8:kworker.0 00000400:00000100:2.0:1787360069.547162:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182527870080 offset 0 length 520: 4 00000100:00100000:2.0:1787360069.547182:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527870208:0@lo:8:kworker.0 00000400:00000100:2.0:1787360069.547197:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874182527870208 offset 0 length 520: 4 00000100:00100000:2.0:1787360069.547217:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527870336:0@lo:400:kworker.0 00000100:00100000:2.0:1787360069.547250:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360069.547430:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527870336 00000100:00100000:0.0:1787360069.547440:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527870336 00000100:00100000:0.0:1787360069.547497:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360069.547507:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527870336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360069.547632:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527870336:12345-0@lo:400:kworker.0 Request processed in 125us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360069.547640:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787360069.547734:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d3f98ca80 x1874182527870336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360069.547748:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527870336:0@lo:400:kworker.0 00000100:00100000:0.0:1787360069.548144:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527869952 00000100:00100000:0.0:1787360069.548149:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527869952 00000100:00100000:0.0:1787360069.548189:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787360069.548197:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3320:x1874182527869952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360069.548239:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:3320:x1874182527869952:12345-0@lo:400:kworker.0 Request processed in 43us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360069.548245:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787360069.548384:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527869952:0@lo:400:kworker.0 00010000:00010000:0.0:1787360070.122171:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360071.143302:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787360071.656860:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787360071.718341:0:15145:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787360071.718345:0:15145:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787360071.718450:0:15145:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff983d1101e800 00000020:01000004:0.0:1787360071.718466:0:15145:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787360071.718479:0:15145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787360071.718493:0:15145:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff983d11013370) 00000020:00000080:0.0:1787360071.718511:0:15145:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787360071.736021:0:15145:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787360071.736298:0:15145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787360071.740474:0:15145:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787360071.742194:0:15145:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787360071.742466:0:15145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787360071.743202:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 277: rc = 0 00100000:10000000:0.0:1787360071.743302:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 277: rc = 0 00100000:10000000:0.0:1787360071.743402:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 277: rc = 0 00100000:10000000:0.0:1787360071.744244:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 542: rc = 0 00100000:10000000:0.0:1787360071.744769:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 542: rc = 0 00100000:10000000:0.0:1787360071.745174:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 542: rc = 0 00100000:10000000:0.0:1787360071.746506:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 542: rc = 0 00100000:10000000:2.0:1787360071.747228:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 542: rc = 0 00100000:10000000:2.0:1787360071.747562:0:15145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 542: rc = 0 00000020:00000080:2.0:1787360071.748404:0:15145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787360071.748417:0:15145:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787360071.748430:0:15145:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72f6de40e4ef483a 00000020:01000004:2.0:1787360071.748439:0:15145:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787360071.748463:0:15145:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787360071.748467:0:15145:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787360071.748473:0:15145:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787360071.748478:0:15145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787360071.748491:0:15145:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff983d39bf0000) 00000020:00000080:2.0:1787360071.748502:0:15145:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787360071.749811:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360071.749988:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787360071.749996:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787360071.754642:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787360071.764014:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787360071.764225:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787360071.764232:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787360071.766164:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787360071.766379:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787360071.766386:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787360071.768206:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787360071.768218:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787360071.788500:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360071.790098:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787360071.790109:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787360071.798199:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787360071.798216:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787360071.801706:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787360071.801726:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787360071.804638:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787360071.804879:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787360071.804886:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787360071.806342:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787360071.806354:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787360071.856467:0:15145:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787360071.856723:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787360071.856731:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787360071.862518:0:15145:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787360071.862538:0:15145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787360071.863313:0:15145:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787360071.863341:0:15145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787360071.863348:0:15145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787360071.879970:0:15145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787360071.880010:0:15145:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.114@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787360071.880019:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787360071.880021:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360071.880022:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360071.880023:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360071.880024:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360071.880025:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360071.880026:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360071.880028:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360071.880029:0:15145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360071.880033:0:15145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787360071.880035:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360071.880036:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360071.880037:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360071.880038:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360071.880039:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360071.880040:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360071.880041:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360071.880042:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360071.880042:0:15145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360071.880100:0:15145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787360071.880125:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870464:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360071.880200:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360071.880267:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09672780 going to sleep for 11 seconds 00000100:00100000:0.0:1787360071.880395:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527870464 00000100:00100000:0.0:1787360071.880407:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527870464 00000100:00100000:0.0:1787360071.880477:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787360071.880489:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:15145:x1874182527870464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787360071.880522:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787360071.880526:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787360071.880529:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787360071.899433:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:15145:x1874182527870464:12345-0@lo:253:mount.lustre.0 Request processed in 18933us (19219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.899453:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787360071.899585:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787360071.899604:0:15145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787360071.899607:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787360071.899609:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787360071.899610:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360071.899612:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360071.899613:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360071.899614:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360071.899616:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360071.899618:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360071.899619:0:15145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787360071.899641:0:15145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff983d1101e800 from lustre-OST0000 10000000:01000000:2.0:1787360071.899668:0:15145:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787360071.899672:0:15145:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787360071.899700:0:15145:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff983d3f650000 local copy 00010000:00010000:2.0:1787360071.899713:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360071.900122:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360071.900167:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.900213:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d18321840 going to sleep for 11 seconds 00000100:00100000:1.0:1787360071.900292:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527870592 00000100:00100000:1.0:1787360071.900301:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527870592 00000100:00100000:1.0:1787360071.900351:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787360071.900362:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:15145:x1874182527870592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360071.900534:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:15145:x1874182527870592:12345-0@lo:501:mount.lustre.0 Request processed in 173us (365us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787360071.900542:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787360071.900672:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870592:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787360071.900706:0:15145:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787360071.900871:0:15145:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787360071.900879:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.900889:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360071.901066:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff983d1101e800 10000000:01000000:2.0:1787360071.901072:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787360071.901077:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff983d3f650000 10000000:01000000:2.0:1787360071.901080:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787360071.901083:0:15145:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff983d3f650000 from 1 10000000:01000000:2.0:1787360071.901086:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787360071.901116:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.901125:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.901137:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360071.901152:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360071.901183:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.901216:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d18321840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.901282:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527870720 00000100:00100000:3.0:1787360071.901287:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527870720 00000100:00100000:3.0:1787360071.901328:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787360071.901337:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+12:15145:x1874182527870720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360071.901346:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360071.901361:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62200/0x72f6de40e4ef484f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4848 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.901400:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62200/0x72f6de40e4ef484f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4848 expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.901411:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62200/0x72f6de40e4ef484f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4848 expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.901421:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62200, rc 0) 00000100:00100000:3.0:1787360071.901463:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+13:15145:x1874182527870720:12345-0@lo:101:mount.lustre.0 Request processed in 127us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.901469:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787360071.901597:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360071.901611:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef484f expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.901621:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef484f expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360071.901635:0:15145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787360071.901651:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef484f expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.901669:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05347e00/0x72f6de40e4ef4848 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef484f expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360071.901709:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787360071.901714:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787360071.901718:0:15145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787360071.901720:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787360071.901735:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.901742:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.901750:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360071.901763:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787360071.901904:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.901996:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d18321840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.902111:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527870848 00000100:00100000:3.0:1787360071.902116:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527870848 00000100:00100000:3.0:1787360071.902149:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787360071.902157:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+13:15145:x1874182527870848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360071.902164:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360071.902173:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef485d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4856 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.902186:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef485d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4856 expref: 14 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.902194:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62c00/0x72f6de40e4ef485d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4856 expref: 14 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.902201:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62c00, rc 0) 00000100:00100000:3.0:1787360071.902236:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527870848:12345-0@lo:101:mount.lustre.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.902242:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787360071.902366:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360071.902379:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef485d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.902386:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef485d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360071.904126:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787360071.905300:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360071.905586:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787360071.905635:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787360071.905670:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787360071.905767:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787360071.906307:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787360071.906347:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787360071.906458:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787360071.906467:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787360071.906576:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360071.906646:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.906714:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d18321840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.907009:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527870976 00000100:00100000:3.0:1787360071.907019:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527870976 00000100:00100000:3.0:1787360071.907092:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360071.907103:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527870976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360071.910652:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527870976:12345-0@lo:501:mount.lustre.0 Request processed in 3542us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360071.910667:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787360071.910839:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527870976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360071.910906:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360071.911134:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360071.911222:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d136089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360071.912604:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871104 00000100:00100000:0.0:1787360071.912618:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871104 00000100:00100000:0.0:1787360071.912752:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787360071.912765:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360071.913237:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871104:12345-0@lo:503:mount.lustre.0 Request processed in 473us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360071.913257:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787360071.913389:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787360071.914130:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360071.914223:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360071.914284:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.914814:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d18321840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.914980:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871232 00000100:00100000:3.0:1787360071.914988:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871232 00000100:00100000:3.0:1787360071.915030:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787360071.915040:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360071.915307:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871232:12345-0@lo:502:mount.lustre.0 Request processed in 267us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.915316:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787360071.915537:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360071.915828:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787360071.915882:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787360071.915932:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787360071.915984:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787360071.916038:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787360071.916086:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787360071.916135:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787360071.916170:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787360071.916201:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787360071.916246:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787360071.916284:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787360071.916331:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787360071.916579:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360071.916646:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.916736:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d18321840 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.917257:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871360 00000100:00100000:3.0:1787360071.917267:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871360 00000100:00100000:3.0:1787360071.917316:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787360071.917325:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360071.917608:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871360:12345-0@lo:502:mount.lustre.0 Request processed in 282us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.917625:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787360071.918040:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360071.918162:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787360071.918176:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787360071.919319:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787360071.919328:0:15159:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787360071.919335:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.919337:0:15159:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787360071.919344:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787360071.919359:0:15159:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff983d39bf19b8) 00000020:00000080:2.0:1787360071.919464:0:15159:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787360071.919472:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787360071.919543:0:15159:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d1101e800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787360071.919550:0:15159:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787360071.919556:0:15159:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x72f6de40e4ef486b 00010000:00010000:2.0:1787360071.926097:0:15159:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787360071.926587:0:15159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787360071.930126:0:15159:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787360071.935789:0:15159:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787360071.935802:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360071.935810:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.935812:0:15159:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787360071.935816:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787360071.935819:0:15159:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787360071.935821:0:15159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360071.935822:0:15159:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787360071.935824:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787360071.935826:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.935828:0:15159:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787360071.935830:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360071.935833:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.935835:0:15159:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787360071.935845:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787360071.935847:0:15159:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787360071.935850:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360071.935852:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.935853:0:15159:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787360071.935855:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360071.935857:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.935859:0:15159:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787360071.935862:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787360071.936074:0:15159:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360071.936078:0:15159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360071.936079:0:15159:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787360071.936083:0:15159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787360071.936239:0:15145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787360071.936276:0:15145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787360071.936300:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef485d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.936313:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05347800/0x72f6de40e4ef4856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef485d expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360071.936321:0:15145:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d1101e800 from 1 10000000:01000000:3.0:1787360071.936323:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787360071.936419:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.936428:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.936441:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360071.936470:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360071.936542:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360071.936589:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871488 00000100:00100000:3.0:1787360071.936599:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871488 00000100:00100000:3.0:1787360071.937348:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360071.937524:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+14:15145:x1874182527871488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360071.937546:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360071.937564:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4872 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.937605:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 15 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.937618:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 15 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.937629:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62a00, rc 0) 00000100:00100000:3.0:1787360071.937711:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871488:12345-0@lo:101:mount.lustre.0 Request processed in 352us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.937719:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787360071.937773:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d136089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360071.938056:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360071.938075:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360071.938085:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360071.938647:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787360071.939267:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787360071.939539:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787360071.939584:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787360071.939659:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787360071.939667:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787360071.939859:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360071.940003:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.940129:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32e7e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360071.941131:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871616 00000100:00100000:0.0:1787360071.941144:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871616 00000100:00100000:0.0:1787360071.941243:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787360071.941255:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787360071.941545:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871616:12345-0@lo:501:mount.lustre.0 Request processed in 291us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360071.941553:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787360071.941653:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360071.941737:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360071.941797:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.946661:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871744 00000100:00100000:2.0:1787360071.946697:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871744 00000100:00100000:2.0:1787360071.946772:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787360071.946796:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360071.947184:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871744:12345-0@lo:503:mount.lustre.0 Request processed in 389us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360071.947193:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787360071.947630:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d13608000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.947663:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360071.949168:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360071.949276:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360071.949359:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360071.949452:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d13608000 going to sleep for 11 seconds 00000100:00100000:2.0:1787360071.949509:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527871872 00000100:00100000:2.0:1787360071.949517:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527871872 00000100:00100000:2.0:1787360071.949617:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787360071.949629:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360071.949876:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527871872:12345-0@lo:502:mount.lustre.0 Request processed in 248us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360071.949885:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787360071.950086:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527871872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360071.950332:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787360071.950381:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787360071.950445:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787360071.950482:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787360071.950530:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787360071.950576:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787360071.950612:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787360071.950642:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787360071.950704:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360071.950751:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360071.951147:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d13608000 going to sleep for 11 seconds 00000100:00100000:2.0:1787360071.951226:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872000 00000100:00100000:2.0:1787360071.951235:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872000 00000100:00100000:2.0:1787360071.951269:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787360071.951279:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527872000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360071.951482:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527872000:12345-0@lo:502:mount.lustre.0 Request processed in 203us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360071.951491:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787360071.951588:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360071.951740:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787360071.951752:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787360071.953069:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360071.953084:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360071.953087:0:15163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787360071.953094:0:15163:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d1101e800 00000020:00000080:3.0:1787360071.953096:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360071.953103:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360071.953106:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360071.953107:0:15163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787360071.953110:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360071.953112:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360071.953113:0:15163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787360071.953116:0:15163:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d1101e800 00000020:00000080:3.0:1787360071.953117:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360071.953182:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360071.953186:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360071.953187:0:15163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787360071.953190:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360071.953192:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360071.953193:0:15163:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787360071.953196:0:15163:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff983d1101e800 00000020:00000080:3.0:1787360071.953199:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787360071.953244:0:15163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360071.953248:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360071.953249:0:15163:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787360071.953252:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787360071.955012:0:15145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787360071.955061:0:15145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787360071.955090:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360071.955105:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360071.955174:0:15145:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787360071.955177:0:15145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff983d1101e800 10000000:01000000:1.0:1787360071.955180:0:15145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff983d1101e800 10000000:01000000:1.0:1787360071.955185:0:15145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787360071.955191:0:15145:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d1101e800 from 1 10000000:01000000:1.0:1787360071.955194:0:15145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787360071.955242:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360071.955250:0:15145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360071.955274:0:15145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360071.955301:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787360071.955375:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360071.955421:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.955566:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872128 00000100:00100000:3.0:1787360071.955576:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872128 00000100:00100000:3.0:1787360071.955638:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787360071.955649:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527872128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360071.955664:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360071.955701:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b63200/0x72f6de40e4ef4887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4880 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.955730:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63200/0x72f6de40e4ef4887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4880 expref: 16 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.955742:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b63200/0x72f6de40e4ef4887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4880 expref: 16 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360071.955753:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63200, rc 0) 00000100:00100000:3.0:1787360071.955877:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872128:12345-0@lo:101:mount.lustre.0 Request processed in 228us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.955885:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787360071.956459:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360071.956480:0:15145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4887 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360071.956492:0:15145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4887 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360071.959457:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787360071.962489:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787360071.965112:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787360071.965202:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787360071.965235:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787360071.965280:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787360071.965315:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787360071.965359:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787360071.965392:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787360071.965423:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787360071.965487:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787360071.965522:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787360071.965553:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787360071.965598:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787360071.965635:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787360071.965669:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787360071.965757:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787360071.970164:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787360071.970239:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787360071.970317:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787360071.970354:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787360071.970386:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787360071.970433:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787360071.970467:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787360071.970497:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787360071.970542:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787360071.970602:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787360071.970639:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787360071.970726:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787360071.970765:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787360071.974083:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787360071.974106:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787360071.974232:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360071.974302:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360071.974351:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.974918:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872256 00000100:00100000:3.0:1787360071.974929:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872256 00000100:00100000:3.0:1787360071.974985:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787360071.974996:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360071.975281:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872256:12345-0@lo:501:mount.lustre.0 Request processed in 286us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.975289:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787360071.980225:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360071.980308:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360071.980393:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360071.980487:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787360071.984384:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872384 00000100:00100000:2.0:1787360071.984400:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872384 00000100:00100000:2.0:1787360071.984883:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787360071.984896:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787360071.985177:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872384:12345-0@lo:503:mount.lustre.0 Request processed in 282us (4783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360071.985186:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787360071.989751:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787360071.991124:0:15145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787360071.991225:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360071.991316:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360071.992035:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d032166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360071.995548:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872512 00000100:00100000:3.0:1787360071.995565:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872512 00000100:00100000:3.0:1787360071.995625:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787360071.995634:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360071.997176:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872512:12345-0@lo:502:mount.lustre.0 Request processed in 1536us (5853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360071.997188:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787360071.998103:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360071.998427:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787360071.998489:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787360071.998524:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787360071.998563:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787360071.998591:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787360071.998641:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787360071.998668:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787360071.998717:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787360071.998756:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787360071.998796:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787360071.998824:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787360071.998881:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787360072.001478:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787360072.001595:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787360072.001705:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787360072.001745:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787360072.001774:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787360072.003775:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787360072.004029:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787360072.004081:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787360072.004132:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787360072.004164:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787360072.004197:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787360072.004248:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787360072.004286:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787360072.004320:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787360072.004366:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787360072.004405:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787360072.004439:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787360072.004509:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787360072.004549:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787360072.004585:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787360072.004619:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787360072.004667:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787360072.004734:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787360072.005086:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787360072.005131:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787360072.005166:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787360072.005231:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787360072.005268:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787360072.005327:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360072.005410:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360072.005465:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360072.005472:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872640 00000100:00100000:2.0:1787360072.005481:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872640 00000100:00100000:2.0:1787360072.005538:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787360072.005550:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787360072.005805:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527872640:12345-0@lo:502:mount.lustre.0 Request processed in 254us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360072.005813:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787360072.006081:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527872640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787360072.006162:0:15145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787360072.006172:0:15145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787360072.007673:0:15168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787360072.008076:0:15168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff983d3f653370) 00000020:00000080:1.0:1787360072.008106:0:15168:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787360072.008182:0:15168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d1101e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787360072.008187:0:15168:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d1101e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787360072.008190:0:15168:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d1101e800 3 00010000:00080000:1.0:1787360072.008224:0:15168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983d114ba000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.114@tcp at head 00010000:00010000:0.0:1787360072.011653:0:15168:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787360072.012539:0:15168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787360072.012584:0:15168:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787360072.012596:0:15168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x72f6de40e4ef4895 00000100:00080000:0.0:1787360072.012607:0:15168:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787360072.012614:0:15168:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff983d114ba000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787360072.012665:0:15168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d40994000 x1874182527872768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360072.012725:0:15168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360072.012749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360072.012754:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787360072.012757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360072.012759:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787360072.012818:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360072.012832:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527872896:0@lo:400:kworker.0 00000100:00100000:1.0:1787360072.013024:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1874182527872768:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787360072.013101:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360072.013261:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360072.013327:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872768 00000100:00100000:0.0:1787360072.013335:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872768 00000100:00100000:0.0:1787360072.013364:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527872896 00000100:00100000:0.0:1787360072.013367:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527872896 00000100:00100000:0.0:1787360072.013397:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360072.013408:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527872896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360072.013470:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527872896:12345-0@lo:400:kworker.0 Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360072.013477:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360072.013494:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360072.013498:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1874182527872768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360072.013522:0:14466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1787360072.013553:0:14466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x72f6de40e4ef489c 00000004:00100000:0.0:1787360072.013568:0:14466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787360072.013605:0:14466:0:(import.c:65:import_set_state_nolock()) ffff983d200ee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360072.013648:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874182527872768:12345-0@lo:38:llog_process_th.0 Request processed in 148us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360072.013655:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787360072.013737:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d40994000 x1874182527872768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360072.013748:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787360072.013758:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787360072.013766:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787360072.013772:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787360072.014107:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d114ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787360072.014115:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1874182527872768:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787360072.014162:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff983d40995180 x1874182527872896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360072.014173:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527872896:0@lo:400:kworker.0 00000040:00080000:0.0:1787360072.014546:0:15168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787360072.014816:0:15145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787360072.014845:0:15145:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787360072.014875:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4887 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.014888:0:15145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d200c2200/0x72f6de40e4ef4880 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4887 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787360072.015057:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787360072.015059:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360072.015061:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360072.015062:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360072.015064:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360072.015066:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360072.015067:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360072.015069:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360072.015071:0:15145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787360072.015075:0:15145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787360072.015078:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360072.015079:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787360072.015081:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360072.015082:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360072.015083:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360072.015085:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360072.015086:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360072.015087:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360072.015088:0:15145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787360072.015119:0:15145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787360072.015138:0:15145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527873024:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360072.015194:0:15145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360072.015232:0:15145:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d136089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360072.017399:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873024 00000100:00100000:3.0:1787360072.017416:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873024 00000100:00100000:3.0:1787360072.017488:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787360072.017500:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15145:x1874182527873024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787360072.017554:0:14460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787360072.017569:0:14460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787360072.048263:0:14460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787360072.048287:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787360072.048703:0:14481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787360072.048710:0:14481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787360072.048735:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.048755:0:14481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 16 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.048765:0:14481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.048814:0:14481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 16 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.048829:0:14481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 16 pid: 14460 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360072.048844:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14481:1874182527873152:0@lo:104: 00000100:00100000:3.0:1787360072.048926:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360072.048970:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360072.049263:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873152 00000100:00100000:0.0:1787360072.049274:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873152 00000100:00100000:0.0:1787360072.049326:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360072.049337:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14481:x1874182527873152:12345-0@lo:104: 00010000:00010000:0.0:1787360072.049350:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.049411:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360072.049418:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14481:x1874182527873152:12345-0@lo:104: Request processed in 83us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360072.049426:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787360072.049452:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360072.049459:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.049466:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360072.049470:0:14454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.049479:0:14454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360072.049504:0:14454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360072.049511:0:14454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360072.049544:0:14454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.049551:0:14454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360072.049572:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.049579:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d05347400/0x72f6de40e4ef4809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef4810 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.049595:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360072.049597:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360072.049598:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360072.049623:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527873280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360072.049653:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360072.049739:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14481:1874182527873152:0@lo:104: 00010000:00010000:0.0:1787360072.049761:0:14481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360072.050926:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873280 00000100:00100000:3.0:1787360072.050946:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873280 00010000:00010000:3.0:1787360072.050976:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 17 pid: 14460 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360072.051012:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360072.051022:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:3319:x1874182527873280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787360072.051037:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360072.051053:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 17 pid: 14460 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051065:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 17 pid: 14460 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051082:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d05346600/0x72f6de40e4ef4810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef4809 expref: 17 pid: 14460 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051099:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051107:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787360072.051123:0:14452:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002413833s 00010000:00010000:3.0:1787360072.051127:0:14452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051133:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051139:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051155:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051161:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360072.051166:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051173:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051188:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360072.051200:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360072.051255:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3319:x1874182527873280:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360072.051263:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360072.051463:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527873280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360072.051491:0:14481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.051499:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360072.051513:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62600/0x72f6de40e4ef48a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360072.056838:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:15145:x1874182527873024:12345-0@lo:253:mount.lustre.0 Request processed in 39331us (41634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360072.056853:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787360072.057016:0:15145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15145:1874182527873024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360072.057035:0:15145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787360072.057039:0:15145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360072.057041:0:15145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787360072.057051:0:15145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360072.057052:0:15145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360072.057054:0:15145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360072.057055:0:15145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360072.057057:0:15145:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787360072.057059:0:15145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360072.057060:0:15145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787360072.057075:0:15145:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787360072.061629:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787360072.062145:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787360072.062313:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787360072.062469:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787360072.062619:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787360072.062839:0:15145:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787360072.064183:0:15145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787360072.115512:0:15145:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787360072.115522:0:15145:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787360072.115557:0:15145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787360072.115620:0:15145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787360072.115634:0:15145:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787360072.115666:0:15145:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787360072.166978:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787360073.195519:0:14462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787360073.195525:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d3f3a2800 from 7 10000000:01000000:2.0:1787360073.195529:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787360073.195582:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360073.195591:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360073.195602:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360073.195623:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527873408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360073.195693:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360073.195733:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360073.195753:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873408 00000100:00100000:2.0:1787360073.195768:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873408 00000100:00100000:2.0:1787360073.195812:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787360073.195820:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+15:14462:x1874182527873408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360073.195830:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360073.195842:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef48aa expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360073.195863:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360073.195872:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 16 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360073.195880:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d05346400, rc 0) 00010000:00010000:3.0:1787360073.198877:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360073.199082:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:14462:x1874182527873408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3256us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360073.199094:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787360073.202354:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527873408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360073.202387:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360073.202402:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360073.202492:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527873536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787360073.202555:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360073.202599:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216480 going to sleep for 11 seconds 00000100:00100000:2.0:1787360073.203251:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873536 00000100:00100000:2.0:1787360073.203262:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873536 00000100:00100000:2.0:1787360073.203316:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787360073.203326:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:14462:x1874182527873536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787360073.203349:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787360073.203367:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787360073.203370:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787360073.203466:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:14462:x1874182527873536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360073.203475:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787360073.203781:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527873536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787360073.203857:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787360073.203866:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360073.203875:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360074.216273:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360075.243123:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360076.264389:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360077.231990:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360077.231997:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360077.232000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360077.232003:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360077.232014:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360077.232036:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527873664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.232113:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360077.232181:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873664 00000100:00100000:1.0:1787360077.232191:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873664 00000100:00100000:1.0:1787360077.232259:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787360077.232269:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3319:x1874182527873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.232331:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3319:x1874182527873664:12345-0@lo:400:kworker.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360077.232340:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787360077.232398:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527873664:0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.232445:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527873792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.232476:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360077.232516:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873792 00000100:00100000:1.0:1787360077.232520:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873792 00000100:00100000:1.0:1787360077.235006:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787360077.235027:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527873792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.235127:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527873792:12345-0@lo:400:kworker.0 Request processed in 109us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360077.235136:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787360077.235199:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3f98c380 x1874182527873792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360077.235215:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527873792:0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.235281:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527873920:0@lo:400:kworker.0 00000100:00100000:1.0:1787360077.235593:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360077.240992:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527873920 00000100:00100000:3.0:1787360077.241011:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527873920 00000100:00100000:3.0:1787360077.241146:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360077.241159:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527873920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360077.241260:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527873920:12345-0@lo:400:kworker.0 Request processed in 104us (5666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360077.241269:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787360077.241407:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3f98c380 x1874182527873920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360077.241427:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527873920:0@lo:400:kworker.0 00000100:00080000:0.0:1787360077.246102:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787360077.286851:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360078.310823:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787360078.820988:0:15512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787360079.336642:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360080.360801:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360081.383059:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360081.895418:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787360082.347077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360082.347084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787360082.347087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360082.347089:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787360082.347142:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527874048:0@lo:400:kworker.0 00000100:00100000:1.0:1787360082.347231:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360082.347290:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787360082.347297:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527874176:0@lo:400:kworker.0 00000100:00100000:1.0:1787360082.347328:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360082.347360:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527874304:0@lo:400:kworker.0 00000100:00100000:1.0:1787360082.347383:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360082.347424:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874176 00000100:00100000:1.0:1787360082.347434:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874176 00000100:00100000:1.0:1787360082.347478:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874304 00000100:00100000:1.0:1787360082.347482:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874304 00000100:00100000:1.0:1787360082.347524:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360082.347534:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527874176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360082.347593:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527874176:12345-0@lo:400:kworker.0 Request processed in 60us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360082.347600:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787360082.347620:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360082.347626:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527874304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360082.347656:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527874304:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360082.347702:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787360082.347743:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3f98d880 x1874182527874304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360082.347758:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527874304:0@lo:400:kworker.0 00010000:00080000:1.0:1787360082.347788:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3f98e300 x1874182527874176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360082.347797:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527874176:0@lo:400:kworker.0 00000100:00080000:1.0:1787360082.349952:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360082.353396:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874048 00000100:00100000:3.0:1787360082.353412:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874048 00000100:00100000:3.0:1787360082.353486:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360082.353498:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3319:x1874182527874048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360082.353617:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3319:x1874182527874048:12345-0@lo:400:kworker.0 Request processed in 120us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360082.353624:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787360082.355878:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527874048:0@lo:400:kworker.0 00010000:00010000:2.0:1787360082.408396:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360083.430895:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360084.263272:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360069/real 1787360069] req@ffff983d3f98f100 x1874182527870080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360084.263303:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff983d3f98f100 x1874182527870080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360084.263314:0:3316:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787360069/real 1787360069] req@ffff983d3f98f800 x1874182527870208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360084.263324:0:3316:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff983d3f98f800 x1874182527870208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787360084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787360084.263344:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d275f2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360084.263369:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787360084.263373:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527870080:0@lo:8:kworker.0 00000100:00080000:1.0:1787360084.263379:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787360084.263383:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787360084.263386:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527870208:0@lo:8:kworker.0 00000100:00080000:0.0:1787360084.263546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360084.263551:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787360084.263555:0:37:0:(import.c:65:import_set_state_nolock()) ffff983d275f2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360084.263560:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787360084.263566:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360084.263572:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff983d275f2000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787360084.263592:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d40996d80 x1874182527874560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787360084.263606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360084.263609:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360084.263611:0:37:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360084.263614:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787360084.263616:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787360084.263619:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff983d11452800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787360084.263626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d40997100 x1874182527874688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360084.263671:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527874816:0@lo:400:kworker.0 00000100:00100000:0.0:1787360084.263766:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360084.263828:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360084.263864:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527874944:0@lo:400:kworker.0 00000100:00100000:0.0:1787360084.263888:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360084.263963:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360084.263973:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527874432:0@lo:400:kworker.0 00000100:00100000:2.0:1787360084.264004:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360084.264184:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874432 00000100:00100000:0.0:1787360084.264194:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874432 00000100:00100000:0.0:1787360084.264250:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787360084.264260:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3317:x1874182527874432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360084.264320:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:3317:x1874182527874432:12345-0@lo:400:kworker.0 Request processed in 61us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360084.264329:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787360084.264372:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527874432:0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.264622:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874816 00000100:00100000:1.0:1787360084.264627:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874816 00000100:00100000:1.0:1787360084.264660:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874944 00000100:00100000:1.0:1787360084.264663:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874944 00000100:00100000:1.0:1787360084.264721:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787360084.264728:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527874816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.264773:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527874816:12345-0@lo:400:kworker.0 Request processed in 45us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360084.264779:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787360084.264791:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787360084.264798:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527874944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360084.264825:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527874944:12345-0@lo:400:kworker.0 Request processed in 29us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360084.264830:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787360084.264879:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d40994a80 x1874182527874944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360084.264890:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527874944:0@lo:400:kworker.0 00010000:00080000:1.0:1787360084.264899:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d40997800 x1874182527874816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787360084.264906:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527874816:0@lo:400:kworker.0 00000100:00100000:3.0:1787360084.265335:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527874560:0@lo:8:kworker.0 00000100:00100000:3.0:1787360084.265377:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360084.265411:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527874688:0@lo:8:kworker.0 00000100:00100000:3.0:1787360084.266241:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360084.266349:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874560 00000100:00100000:2.0:1787360084.266359:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874560 00000100:00100000:2.0:1787360084.266390:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527874688 00000100:00100000:2.0:1787360084.266393:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527874688 00000100:00100000:2.0:1787360084.266407:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360084.266414:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1874182527874560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787360084.266446:0:15148:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:2.0:1787360084.266476:0:15148:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef48b8 00002000:00100000:2.0:1787360084.266490:0:15148:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff983d1df99800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787360084.266494:0:15148:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787360084.266497:0:15148:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787360084.266889:0:15148:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787360084.266918:0:15148:0:(import.c:65:import_set_state_nolock()) ffff983d1df9d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360084.266996:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874182527874560:12345-0@lo:8:kworker.0 Request processed in 581us (1618us total) trans 0 rc 0/0 00000100:00080000:0.0:1787360084.266997:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360084.267004:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360084.267026:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360084.267035:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1874182527874688:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787360084.267048:0:15148:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787360084.267077:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1874182527874688:12345-0@lo:8:kworker.0 Request processed in 41us (1645us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787360084.267173:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787360084.267552:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d40996d80 x1874182527874560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787360084.267565:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787360084.267574:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787360084.267583:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787360084.267589:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787360084.267592:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d275f2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787360084.267620:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787360084.267626:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527874560:0@lo:8:kworker.0 00000100:00080000:3.0:1787360084.267641:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787360084.267645:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787360084.267648:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527874688:0@lo:8:kworker.0 00000004:00080000:2.0:1787360084.267774:0:14488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787360084.267797:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14488:1874182527875200:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787360084.267847:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360084.267869:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dab480 going to sleep for 11 seconds 00000100:00100000:3.0:1787360084.267878:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875200 00000100:00100000:3.0:1787360084.267884:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875200 00000100:00100000:0.0:1787360084.267934:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527875072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360084.267939:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360084.267947:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14488:x1874182527875200:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787360084.267970:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787360084.268428:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787360084.269197:0:14487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787360084.269583:0:14487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 458597904646ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787360084.274579:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875072 00000100:00100000:2.0:1787360084.274598:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875072 00000100:00100000:2.0:1787360084.274670:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360084.274712:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527875072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787360084.274754:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360084.274862:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527875072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (6890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360084.274869:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787360084.274923:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d1e177800 x1874182527875072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360084.274944:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527875072:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1787360084.278904:0:15146:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787360084.278915:0:15146:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787360084.278921:0:15146:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787360084.293003:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.293015:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293038:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.293043:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.293059:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293079:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293092:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293114:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293144:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360084.293221:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.293229:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.293250:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.293255:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.293264:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.293285:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.293292:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064250886/0x72f6de40e4ef48bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.293311:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.293313:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.293315:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.293575:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.293581:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293589:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.293592:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.293596:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293605:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293612:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293629:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.293653:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.293754:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.293761:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.293768:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.293771:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.293779:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.293793:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.293800:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dae857e/0x72f6de40e4ef48c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.293815:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.293817:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.293819:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.294243:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.294250:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294259:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.294263:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.294267:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294277:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294286:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294293:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294314:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360084.294605:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.294611:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.294620:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.294624:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.294632:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.294653:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.294660:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a695a3a2/0x72f6de40e4ef48cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.294704:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.294706:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.294708:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.294890:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.294896:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294909:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.294912:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.294917:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294925:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294933:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294940:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.294960:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.294977:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.294982:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.294990:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.294993:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.295011:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.295024:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.295031:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc0b4531/0x72f6de40e4ef48d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.295043:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.295044:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.295046:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.295861:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.295870:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.295881:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.295885:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.295889:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.295899:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.295919:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.295928:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.295948:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360084.296414:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.296422:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.296431:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.296436:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.296445:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.296461:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.296468:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079915625/0x72f6de40e4ef48db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.296501:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.296503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.296504:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.296554:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.296560:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.296567:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.296571:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.296575:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.296584:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.296592:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.296598:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.296629:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.296738:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.296744:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.296751:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.296755:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.296762:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.296773:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.296793:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff89be47/0x72f6de40e4ef48e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.296809:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.296811:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.296813:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.297425:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.297432:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.297442:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.297446:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.297451:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.297460:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.297468:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.297477:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.297499:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.297599:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.297605:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.297613:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05347400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.297617:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.297625:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.297637:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.297645:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014725548/0x72f6de40e4ef48e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.297660:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.297662:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.297664:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.298070:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.298077:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298085:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.298094:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.298099:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298179:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298188:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298197:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298217:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360084.298660:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.298666:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298772:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.298775:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.298779:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298789:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298798:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298812:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.298841:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787360084.299030:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360084.299039:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299047:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.299052:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299059:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299074:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299081:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ab0167/0x72f6de40e4ef48f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299099:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.299103:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299109:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.299112:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299119:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299143:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299150:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d994f324/0x72f6de40e4ef48f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299164:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.299166:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.299168:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.299304:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.299310:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299319:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.299322:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.299326:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299336:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299344:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299353:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299372:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.299445:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.299450:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299457:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.299461:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299468:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299478:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299486:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f591f223/0x72f6de40e4ef48fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.299511:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.299513:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.299515:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.299931:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.299937:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299951:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.299954:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.299959:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299968:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299976:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.299985:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.300006:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.300483:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1787360084.300483:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787360084.300490:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.300490:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300499:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.300499:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.300502:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360084.300503:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.300507:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300513:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.300516:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300526:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300534:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026eb84c4/0x72f6de40e4ef4905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.300535:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.300543:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300550:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.300550:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.300552:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.300555:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300562:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.300583:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300591:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300602:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300609:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084ccb4fd/0x72f6de40e4ef490c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.300621:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.300623:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.300624:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.300994:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.301000:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301008:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.301011:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.301015:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301022:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301030:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301036:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301342:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360084.301355:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360084.301360:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301368:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.301371:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301388:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301400:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301407:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.301420:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.301421:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.301423:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.302005:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.302013:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302023:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.302033:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.302039:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302049:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302057:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302064:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302079:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360084.302089:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360084.302092:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302166:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.302171:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302180:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302190:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302207:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef491a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302220:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.302222:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.302224:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.302619:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.302625:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302633:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.302637:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.302641:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302650:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302658:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.302664:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.303174:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.303182:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.303191:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.303195:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.303202:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.303216:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.303224:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.303225:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.303227:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.303818:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360084.303826:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.304005:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.304523:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.304530:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304542:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.304546:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.304553:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304563:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304572:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304580:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304596:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360084.304606:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360084.304611:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304618:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.304622:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304636:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304651:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304658:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef4928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.304807:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.304810:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.304812:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.305284:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.305291:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305301:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.305304:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.305308:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305317:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305325:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305339:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305356:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360084.305366:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360084.305371:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305392:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.305395:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305403:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305413:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305420:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef492f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.305432:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.305434:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.305435:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.305983:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.305997:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306005:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.306008:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.306012:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306019:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306027:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306033:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306107:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360084.306495:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.306501:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306510:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.306513:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.306517:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306525:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306537:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306544:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306864:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787360084.306877:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360084.306883:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306892:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.306896:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306904:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306919:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306926:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306943:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360084.306952:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306958:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.306961:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306968:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306977:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306983:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef493d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.306994:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.306996:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.306998:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.307220:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.307859:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.307866:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.307877:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.307881:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.307886:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.307907:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.307916:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.307924:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.307983:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360084.308434:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.308440:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.308449:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.308452:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.308456:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.308466:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.308474:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.308493:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308636:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360084.308642:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308651:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.308655:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308664:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308727:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308735:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b267358b/0x72f6de40e4ef4944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308752:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.308755:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308762:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.308766:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308774:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308784:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.308790:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.308792:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.308794:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.308949:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360084.308954:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef494b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360084.309514:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.309521:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.309530:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.309534:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.309538:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.309548:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.309555:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.309563:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.309600:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.309606:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.309635:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.309639:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.309646:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.309657:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.309665:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.309666:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.309727:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.310058:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360084.310064:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787360084.310818:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.310826:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.310854:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.310857:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.310862:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.310873:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.310881:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.310888:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.310917:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787360084.311877:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.311886:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.311906:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.311909:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.311915:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.311926:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.311934:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.311941:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.311953:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787360084.311995:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360084.312003:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312011:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.312017:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312032:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312054:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312061:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053f57d5b/0x72f6de40e4ef4959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312080:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.312084:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312091:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.312094:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312101:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312111:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312118:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312143:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.312145:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.312147:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.312246:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.312533:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.312539:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.312549:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.312552:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.312556:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.312564:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.312584:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.312591:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.312615:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360084.312957:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.312963:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312971:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.312974:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312982:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.312995:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.313003:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1efbc8b/0x72f6de40e4ef4967 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.313019:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.313021:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.313022:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.313187:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.313193:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313202:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.313205:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.313210:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313219:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313227:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313234:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313260:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360084.313293:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360084.313299:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.313308:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360084.313311:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.313320:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.313332:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.313346:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425e1b31/0x72f6de40e4ef496e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360084.313361:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.313363:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360084.313365:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.313815:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.313821:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313830:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.313849:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.313853:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313863:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313870:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313877:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313891:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360084.313900:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360084.313904:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313910:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360084.313919:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313927:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313938:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313945:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065aede87/0x72f6de40e4ef4975 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.313958:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.313960:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360084.313962:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787360084.314486:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360084.314492:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.314501:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787360084.314504:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360084.314507:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.314516:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.314523:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.314534:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360084.314558:0:15146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360084.314805:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360084.314812:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787360084.314825:0:15146:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:1.0:1787360084.314830:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360084.314845:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.314853:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.314863:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.314870:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de749338/0x72f6de40e4ef497c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360084.314883:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.314884:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360084.314886:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360084.314944:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14488:x1874182527875200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 46992us (47090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360084.314954:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787360084.315300:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14488:1874182527875200:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787360084.315315:0:14488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787360084.315366:0:14488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14488:1874182527875328:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787360084.315407:0:14488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360084.315433:0:14488:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787360084.315468:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875328 00000100:00100000:1.0:1787360084.315475:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875328 00000100:00100000:1.0:1787360084.315516:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787360084.315525:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14488:x1874182527875328:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787360084.315567:0:15149:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787360084.318800:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14488:x1874182527875328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3269us (3386us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787360084.318812:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360084.319731:0:14488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14488:1874182527875328:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787360084.319750:0:14488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1787360084.326747:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787360084.464201:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360085.481288:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787360085.751534:0:15865:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787360085.751539:0:15865:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787360085.752007:0:15865:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff983d03cf3000 00000020:01000004:3.0:1787360085.752026:0:15865:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787360085.752043:0:15865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787360085.752061:0:15865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff983d39ddcd28) 00000020:00000080:3.0:1787360085.752211:0:15865:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787360085.776194:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787360085.777253:0:15865:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787360085.778723:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787360085.779139:0:15865:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787360085.779563:0:15865:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787360085.780234:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1787360085.780335:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1787360085.780509:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1787360085.781187:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1787360085.781602:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787360085.782015:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1787360085.782365:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787360085.782739:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787360085.783144:0:15865:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1787360085.784213:0:15865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787360085.784226:0:15865:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787360085.784250:0:15865:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72f6de40e4ef498a 00000020:01000004:3.0:1787360085.784259:0:15865:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787360085.784279:0:15865:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787360085.784283:0:15865:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787360085.784290:0:15865:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787360085.784317:0:15865:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787360085.784322:0:15865:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787360085.794225:0:15865:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787360085.794267:0:15865:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.114@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787360085.794272:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787360085.794274:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787360085.794279:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360085.794281:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360085.794282:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360085.794283:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360085.794284:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360085.794286:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360085.794287:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360085.794291:0:15865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787360085.794293:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787360085.794294:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787360085.794295:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360085.794296:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360085.794296:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360085.794297:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360085.794298:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360085.794299:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360085.794300:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787360085.794350:0:15865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787360085.794374:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875456:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787360085.794519:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.794653:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f873f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787360085.794755:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875456 00000100:00100000:2.0:1787360085.794771:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875456 00000100:00100000:2.0:1787360085.794956:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787360085.794969:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15865:x1874182527875456:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787360085.795013:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787360085.795018:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787360085.795022:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787360085.811543:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15865:x1874182527875456:12345-0@lo:253:mount.lustre.0 Request processed in 16568us (17015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.811558:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787360085.812167:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787360085.812188:0:15865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787360085.812192:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787360085.812194:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787360085.812195:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787360085.812196:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787360085.812198:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787360085.812199:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787360085.812201:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787360085.812202:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787360085.812203:0:15865:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787360085.812225:0:15865:0:(tgt_mount.c:101:server_register_mount()) register mount ffff983d03cf3000 from lustre-OST0001 10000000:01000000:3.0:1787360085.812252:0:15865:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787360085.812255:0:15865:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787360085.812263:0:15865:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff983d3f650000 local copy 00010000:00010000:3.0:1787360085.812275:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360085.812599:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.812647:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.812788:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360085.812992:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875584 00000100:00100000:2.0:1787360085.813001:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875584 00000100:00100000:2.0:1787360085.813286:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787360085.813298:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15865:x1874182527875584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787360085.813620:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15865:x1874182527875584:12345-0@lo:501:mount.lustre.0 Request processed in 323us (972us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787360085.813629:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787360085.813732:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875584:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787360085.813751:0:15865:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787360085.813921:0:15865:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787360085.813929:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360085.813939:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d05346800/0x72f6de40e4ef4730 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4737 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787360085.813963:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff983d03cf3000 10000000:01000000:3.0:1787360085.813968:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787360085.813974:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787360085.813976:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787360085.813981:0:15865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787360085.813983:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787360085.814012:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360085.814021:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360085.814031:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360085.814059:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787360085.814346:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.814756:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.814930:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875712 00000100:00100000:0.0:1787360085.814938:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875712 00000100:00100000:1.0:1787360085.814988:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787360085.814999:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:15865:x1874182527875712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360085.815014:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360085.815027:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d200c2e00/0x72f6de40e4ef4998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4991 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.815054:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2e00/0x72f6de40e4ef4998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4991 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.815139:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d200c2e00/0x72f6de40e4ef4998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4991 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.815151:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d200c2e00, rc 0) 00000100:00100000:1.0:1787360085.815202:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527875712:12345-0@lo:101:mount.lustre.0 Request processed in 206us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.815209:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787360085.815295:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787360085.815310:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4998 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360085.815320:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4998 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360085.816507:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787360085.817955:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360085.818322:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787360085.818368:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787360085.818478:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787360085.818535:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787360085.818574:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787360085.818609:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787360085.818924:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787360085.818934:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787360085.819035:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.819213:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.819396:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107db40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.819549:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875840 00000100:00100000:1.0:1787360085.819557:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875840 00000100:00100000:1.0:1787360085.819600:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787360085.819611:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527875840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360085.820313:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527875840:12345-0@lo:501:mount.lustre.0 Request processed in 702us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.820323:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787360085.820552:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.820605:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360085.820655:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.820723:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.820909:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527875968 00000100:00100000:0.0:1787360085.820916:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527875968 00000100:00100000:0.0:1787360085.820950:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787360085.820959:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527875968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787360085.821278:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527875968:12345-0@lo:503:mount.lustre.0 Request processed in 319us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.821287:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787360085.821446:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527875968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360085.822264:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360085.822344:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.822392:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.822418:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.822782:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876096 00000100:00100000:0.0:1787360085.822802:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876096 00000100:00100000:0.0:1787360085.822845:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787360085.822855:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527876096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360085.823055:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527876096:12345-0@lo:502:mount.lustre.0 Request processed in 200us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.823172:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787360085.823344:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360085.823972:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787360085.824024:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787360085.824056:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787360085.824188:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787360085.824228:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787360085.824262:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787360085.824309:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787360085.824345:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787360085.824393:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787360085.824519:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.824585:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.824720:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1107db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360085.824954:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876224 00000100:00100000:2.0:1787360085.824963:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876224 00000100:00100000:0.0:1787360085.825185:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787360085.825198:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527876224:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787360085.825419:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527876224:12345-0@lo:502:mount.lustre.0 Request processed in 224us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.825427:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787360085.825594:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360085.825885:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787360085.825900:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787360085.827308:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787360085.827319:0:15866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787360085.827325:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360085.827327:0:15866:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787360085.827335:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787360085.827350:0:15866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff983d39dd8000) 00000020:00000080:3.0:1787360085.827379:0:15866:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787360085.827386:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787360085.827458:0:15866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d03cf3000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787360085.827466:0:15866:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787360085.827474:0:15866:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x72f6de40e4ef49a6 00010000:00010000:3.0:1787360085.830539:0:15866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787360085.832058:0:15866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1787360085.834667:0:15866:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787360085.836500:0:15866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787360085.836511:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360085.836517:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360085.836519:0:15866:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787360085.836523:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360085.836527:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360085.836528:0:15866:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787360085.836531:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787360085.836532:0:15866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787360085.836535:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360085.836537:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360085.836538:0:15866:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787360085.836540:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787360085.836542:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360085.836543:0:15866:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787360085.836546:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787360085.836597:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787360085.836600:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787360085.836601:0:15866:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787360085.836604:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787360085.836944:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787360085.836970:0:15865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787360085.836995:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4998 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.837007:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d25b63600/0x72f6de40e4ef4991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4998 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360085.837014:0:15865:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d03cf3000 from 1 10000000:01000000:1.0:1787360085.837017:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787360085.837062:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.837147:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.837160:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360085.837187:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787360085.837257:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360085.837295:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dab6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.837419:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876352 00000100:00100000:0.0:1787360085.837428:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876352 00000100:00100000:0.0:1787360085.837485:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787360085.837497:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:15865:x1874182527876352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360085.837511:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360085.837525:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef49ad expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.837555:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.837566:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.837576:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40800, rc 0) 00000100:00100000:0.0:1787360085.837621:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876352:12345-0@lo:101:mount.lustre.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.837629:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787360085.838041:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787360085.838058:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.838157:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787360085.838657:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787360085.841711:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360085.842013:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787360085.842058:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787360085.842123:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787360085.842131:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787360085.842249:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.842330:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360085.847540:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876480 00000100:00100000:1.0:1787360085.847558:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876480 00000100:00100000:1.0:1787360085.847629:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787360085.847642:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787360085.848227:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876480:12345-0@lo:501:mount.lustre.0 Request processed in 587us (5894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.848237:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787360085.848476:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360085.848509:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.848576:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360085.848631:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.848655:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.848902:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876608 00000100:00100000:1.0:1787360085.848909:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876608 00000100:00100000:1.0:1787360085.848959:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787360085.848969:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360085.849375:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876608:12345-0@lo:503:mount.lustre.0 Request processed in 406us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.849383:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787360085.849497:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360085.852953:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360085.853199:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.853288:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.853343:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.854541:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876736 00000100:00100000:1.0:1787360085.854553:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876736 00000100:00100000:1.0:1787360085.854628:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787360085.854639:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.855263:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360085.855556:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787360085.855613:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787360085.855704:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787360085.855741:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787360085.855771:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000100:00100000:1.0:1787360085.856171:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876736:12345-0@lo:502:mount.lustre.0 Request processed in 426us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.856184:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:3.0:1787360085.856404:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787360085.856451:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787360085.856486:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787360085.856540:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.856601:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.856737:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f180c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.857001:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876864 00000100:00100000:1.0:1787360085.857010:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876864 00000100:00100000:1.0:1787360085.857161:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787360085.857172:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360085.857376:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876864:12345-0@lo:502:mount.lustre.0 Request processed in 204us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.857384:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787360085.857462:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360085.857593:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787360085.857608:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787360085.859575:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360085.859589:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360085.859591:0:15870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787360085.859598:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d03cf3000 00000020:00000080:2.0:1787360085.859600:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787360085.859608:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360085.859610:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360085.859611:0:15870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787360085.859613:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360085.859615:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360085.859617:0:15870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787360085.859620:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff983d03cf3000 00000020:00000080:2.0:1787360085.859622:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787360085.859771:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360085.859776:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360085.859777:0:15870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787360085.859870:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787360085.859876:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360085.859878:0:15870:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787360085.859883:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff983d03cf3000 00000020:00000080:2.0:1787360085.859885:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787360085.859926:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787360085.859930:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787360085.859931:0:15870:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787360085.859935:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787360085.860168:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787360085.860197:0:15865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787360085.860221:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.860235:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360085.860300:0:15865:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787360085.860303:0:15865:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff983d03cf3000 10000000:01000000:0.0:1787360085.860306:0:15865:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff983d03cf3000 10000000:01000000:0.0:1787360085.860310:0:15865:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787360085.860316:0:15865:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff983d03cf3000 from 1 10000000:01000000:0.0:1787360085.860318:0:15865:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787360085.860370:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.860380:0:15865:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.860394:0:15865:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360085.860422:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787360085.860491:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360085.860539:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d03216780 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.861972:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527876992 00000100:00100000:0.0:1787360085.861985:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527876992 00000100:00100000:0.0:1787360085.862044:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787360085.862058:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527876992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787360085.862204:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360085.862227:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40000/0x72f6de40e4ef49c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef49bb expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.862263:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40000/0x72f6de40e4ef49c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef49bb expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.862292:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40000/0x72f6de40e4ef49c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef49bb expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.862304:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40000, rc 0) 00000100:00100000:0.0:1787360085.863182:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527876992:12345-0@lo:101:mount.lustre.0 Request processed in 1123us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.863191:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787360085.870338:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527876992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787360085.870372:0:15865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49c2 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360085.870387:0:15865:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef49c2 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787360085.871308:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787360085.879626:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360085.880481:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787360085.880532:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787360085.880567:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787360085.880613:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787360085.880643:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787360085.880735:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787360085.880770:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787360085.883208:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787360085.883301:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787360085.883333:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787360085.883368:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787360085.883418:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787360085.883455:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787360085.883489:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787360085.883535:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787360085.883564:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787360085.883589:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787360085.883631:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787360085.883669:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787360085.883738:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787360085.883777:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787360085.885039:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787360085.885177:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787360085.885270:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787360085.885310:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787360085.885344:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787360085.885392:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787360085.885430:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787360085.885463:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787360085.885511:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787360085.885550:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787360085.885598:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787360085.885633:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787360085.885711:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787360085.885749:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787360085.886490:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787360085.886550:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787360085.886657:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787360085.886666:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787360085.889249:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.889327:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.889380:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787360085.889969:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877120 00000100:00100000:3.0:1787360085.889982:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877120 00000100:00100000:3.0:1787360085.890046:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787360085.890057:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.890449:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877120:12345-0@lo:501:mount.lustre.0 Request processed in 392us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360085.890458:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787360085.890519:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787360085.890569:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787360085.890612:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.890862:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d09ccbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.895467:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877248 00000100:00100000:1.0:1787360085.895485:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877248 00000100:00100000:1.0:1787360085.895557:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787360085.895568:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787360085.896197:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877248:12345-0@lo:503:mount.lustre.0 Request processed in 629us (5583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.896206:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787360085.896306:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877248:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787360085.897010:0:15865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787360085.897171:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.897221:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.897270:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.897372:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877376 00000100:00100000:1.0:1787360085.897379:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877376 00000100:00100000:1.0:1787360085.897418:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787360085.897427:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360085.897780:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877376:12345-0@lo:502:mount.lustre.0 Request processed in 353us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.897789:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787360085.897983:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787360085.898293:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787360085.898343:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787360085.898377:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787360085.898422:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787360085.898457:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787360085.898503:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787360085.898542:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787360085.898576:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787360085.898627:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787360085.898664:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787360085.899995:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787360085.900059:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787360085.900187:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787360085.900222:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787360085.900303:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787360085.900341:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787360085.900374:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787360085.900422:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787360085.900457:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787360085.900489:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787360085.900540:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787360085.901233:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787360085.901271:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787360085.901346:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787360085.901385:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787360085.901419:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787360085.901488:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787360085.901527:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787360085.901560:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787360085.901608:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787360085.902784:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787360085.902944:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787360085.902981:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787360085.903045:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787360085.903945:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787360085.904018:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787360085.904057:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787360085.904264:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787360085.904316:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787360085.904355:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787360085.904418:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787360085.904507:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360085.904569:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d07f22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360085.905055:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877504 00000100:00100000:1.0:1787360085.905077:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877504 00000100:00100000:1.0:1787360085.905258:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787360085.905271:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d41cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787360085.905541:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d41cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527877504:12345-0@lo:502:mount.lustre.0 Request processed in 272us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360085.905560:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787360085.906086:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527877504:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787360085.906209:0:15865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787360085.906223:0:15865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787360085.907465:0:15875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787360085.907483:0:15875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff983d32c78000) 00000020:00000080:2.0:1787360085.907508:0:15875:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787360085.907599:0:15875:0:(tgt_mount.c:153:server_get_mount()) get mount ffff983d03cf3000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787360085.907604:0:15875:0:(tgt_mount.c:187:server_put_mount()) put mount ffff983d03cf3000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787360085.907606:0:15875:0:(obd_mount.c:710:lustre_put_lsi()) put ffff983d03cf3000 3 00010000:00080000:2.0:1787360085.907640:0:15875:0:(ldlm_lib.c:102:import_set_conn()) imp ffff983c023b8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.114@tcp at head 00010000:00010000:1.0:1787360085.910542:0:15875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787360085.910956:0:15875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787360085.910998:0:15875:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787360085.911016:0:15875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x72f6de40e4ef49d0 00000100:00080000:1.0:1787360085.911028:0:15875:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787360085.911033:0:15875:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff983c023b8000 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360085.911150:0:15875:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98e300 x1874182527877632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360085.911214:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527877632:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787360085.911288:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787360085.911778:0:15875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787360085.912636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787360085.912642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787360085.912646:0:37:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787360085.912652:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:0.0:1787360085.912658:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787360085.912663:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff983d11452800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:0.0:1787360085.912720:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d40995f80 x1874182527877888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787360085.912893:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527877888:0@lo:8:kworker.0 00000100:00100000:2.0:1787360085.912953:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360085.913003:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877632 00000100:00100000:2.0:1787360085.913013:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877632 00000100:00100000:2.0:1787360085.913053:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360085.913075:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1874182527877632:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787360085.913106:0:14467:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:2.0:1787360085.913145:0:14467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x72f6de40e4ef49d7 00000004:00100000:2.0:1787360085.913162:0:14467:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787360085.913196:0:14467:0:(import.c:65:import_set_state_nolock()) ffff983c023b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360085.913253:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874182527877632:12345-0@lo:38:llog_process_th.0 Request processed in 190us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360085.913262:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787360085.913285:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360085.913295:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527877760:0@lo:400:kworker.0 00000100:00100000:2.0:1787360085.913320:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360085.913350:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877888 00000100:00100000:2.0:1787360085.913354:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877888 00000100:00100000:2.0:1787360085.913374:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527877760 00000100:00100000:2.0:1787360085.913377:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527877760 00000100:00100000:2.0:1787360085.913424:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360085.913431:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527877760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360085.913477:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1874182527877760:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360085.913485:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360085.913499:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360085.913502:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1874182527877888:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787360085.913545:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1874182527877888:12345-0@lo:8:kworker.0 Request processed in 39us (591us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787360085.913552:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787360085.913601:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527877760:0@lo:400:kworker.0 00000100:00100000:2.0:1787360085.913645:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360085.913651:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787360085.913656:0:3316:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787360085.913659:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527877888:0@lo:8:kworker.0 00010000:00080000:2.0:1787360085.913672:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d3f98e300 x1874182527877632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787360095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360085.913716:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787360085.913721:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787360085.913730:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787360085.913735:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787360085.913737:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983c023b8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787360085.913743:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1874182527877632:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787360085.915739:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527878144:0@lo:400:kworker.0 00000100:00100000:0.0:1787360085.915969:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360085.916017:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360085.916024:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527878016:0@lo:400:kworker.0 00000100:00100000:0.0:1787360085.916048:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360085.916153:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878144 00000100:00100000:2.0:1787360085.916164:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878144 00000100:00100000:2.0:1787360085.916216:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878016 00000100:00100000:2.0:1787360085.916219:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878016 00000100:00100000:2.0:1787360085.916239:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360085.916249:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527878144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360085.916305:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527878144:12345-0@lo:400:kworker.0 Request processed in 57us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360085.916314:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787360085.916344:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787360085.916350:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527878016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360085.916381:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1874182527878016:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360085.916388:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787360085.916456:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d40996680 x1874182527878016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360085.916471:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40996680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1874182527878016:0@lo:400:kworker.0 00010000:00080000:0.0:1787360085.916482:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff983d40995f80 x1874182527878144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360085.916498:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527878144:0@lo:400:kworker.0 00000040:00080000:1.0:1787360085.917552:0:15875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787360085.918931:0:15865:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787360085.918970:0:15865:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787360085.918992:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49c2 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360085.919007:0:15865:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f40400/0x72f6de40e4ef49bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49c2 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787360085.919159:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787360085.919161:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787360085.919163:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360085.919164:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360085.919165:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360085.919167:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360085.919168:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360085.919170:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360085.919172:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787360085.919176:0:15865:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787360085.919178:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787360085.919180:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787360085.919181:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787360085.919182:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787360085.919183:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787360085.919184:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787360085.919185:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787360085.919186:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787360085.919187:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787360085.919220:0:15865:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787360085.919240:0:15865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527878272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787360085.919321:0:15865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360085.919366:0:15865:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d128c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.919445:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878272 00000100:00100000:0.0:1787360085.919455:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878272 00000100:00100000:0.0:1787360085.919515:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787360085.919526:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:15865:x1874182527878272:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787360085.919554:0:14460:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787360085.919568:0:14460:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787360085.975378:0:14460:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787360085.975399:0:14460:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787360085.976335:0:14481:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787360085.976342:0:14481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787360085.976368:0:14481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.976389:0:14481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.976398:0:14481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.976448:0:14481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.976464:0:14481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 19 pid: 14458 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360085.976481:0:14481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14481:1874182527878400:0@lo:104: 00000100:00100000:1.0:1787360085.976569:0:14481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360085.976614:0:14481:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dabcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360085.976748:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878400 00000100:00100000:0.0:1787360085.976758:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878400 00000100:00100000:0.0:1787360085.977011:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360085.977023:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14481:x1874182527878400:12345-0@lo:104: 00010000:00010000:0.0:1787360085.977038:0:14449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977214:0:14449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360085.977221:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:14481:x1874182527878400:12345-0@lo:104: Request processed in 201us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.977230:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787360085.977254:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360085.977260:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977267:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d05346000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360085.977271:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977293:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360085.977300:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360085.977306:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787360085.977342:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977349:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360085.977371:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977377:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d05346000/0x72f6de40e4ef48aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef48b1 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977393:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360085.977396:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360085.977397:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360085.977418:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527878528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360085.977448:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360085.977494:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878528 00000100:00100000:0.0:1787360085.977498:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878528 00010000:00010000:0.0:1787360085.977518:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 20 pid: 14458 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360085.977541:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787360085.977547:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+20:3317:x1874182527878528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360085.977565:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360085.977571:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 20 pid: 14458 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977583:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 20 pid: 14458 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977604:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977611:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787360085.977625:0:14452:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002413833s 00010000:00010000:0.0:1787360085.977630:0:14452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977637:0:14452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977646:0:14452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977652:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.977658:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360085.977663:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.977775:0:14481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d05346400/0x72f6de40e4ef48b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef48aa expref: 20 pid: 14458 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360085.977785:0:14481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14481:1874182527878400:0@lo:104: 00010000:00010000:1.0:1787360085.977823:0:14481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.977833:0:14481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360085.977839:0:14481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.978975:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.978999:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.979008:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d200c2c00/0x72f6de40e4ef49de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360085.979025:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360085.979198:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3317:x1874182527878528:12345-0@lo:103:ldlm_bl.0 Request processed in 1649us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.979208:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787360085.979545:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527878528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360085.991372:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10559450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:15865:x1874182527878272:12345-0@lo:253:mount.lustre.0 Request processed in 71837us (72040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360085.991388:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787360085.991831:0:15865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e177b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:15865:1874182527878272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787360085.991852:0:15865:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787360085.991856:0:15865:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787360085.991858:0:15865:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787360085.991859:0:15865:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787360085.991861:0:15865:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787360085.991862:0:15865:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787360085.991863:0:15865:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787360085.991865:0:15865:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787360085.991867:0:15865:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787360085.991869:0:15865:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787360085.991886:0:15865:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787360085.997278:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787360085.997441:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787360085.997814:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787360085.997962:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787360085.998255:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787360085.998456:0:15865:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787360086.004932:0:15865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787360086.033731:0:15865:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787360086.033741:0:15865:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787360086.033791:0:15865:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787360086.033870:0:15865:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787360086.033894:0:15865:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787360086.033927:0:15865:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787360086.503562:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360087.534527:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787360087.554769:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787360087.554936:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:1.0:1787360087.917766:0:14462:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787360087.917809:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff983d3f3a2800 from 8 10000000:01000000:0.0:1787360087.917814:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787360087.917870:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.917881:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.917893:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360087.917920:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527878656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787360087.918002:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360087.918050:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360087.918074:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878656 00000100:00100000:0.0:1787360087.918082:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878656 00000100:00100000:0.0:1787360087.918135:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787360087.918145:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d10558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527878656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360087.918159:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360087.918172:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef49ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef49e5 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.918198:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef49ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef49e5 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.918209:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41600/0x72f6de40e4ef49ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef49e5 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.918232:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41600, rc 0) 00000100:00100000:0.0:1787360087.918275:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d10558c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527878656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360087.918282:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787360087.918337:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527878656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360087.918352:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49ec expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.918361:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef49ec expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360087.918408:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527878784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787360087.918440:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360087.918453:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d32f3c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787360087.918464:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878784 00000100:00100000:0.0:1787360087.918467:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878784 00000100:00100000:0.0:1787360087.920516:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787360087.920534:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527878784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787360087.920566:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787360087.920583:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787360087.920587:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787360087.920733:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527878784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 203us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360087.920741:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787360087.920815:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527878784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787360087.920888:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787360087.920899:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49ec expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360087.920910:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983c02f40c00/0x72f6de40e4ef49e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef49ec expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360088.552529:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360089.516029:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527878912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360089.516107:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360089.516233:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527878912 00000100:00100000:3.0:1787360089.516243:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527878912 00000100:00100000:3.0:1787360089.516310:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360089.516320:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527878912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360089.516357:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787360089.516407:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527878912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360089.516414:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787360089.516469:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787360089.516506:0:3318:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787360089.516527:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527878912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787360089.575555:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360090.604084:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787360091.059508:0:15731:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787360091.059515:0:15731:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787360091.059520:0:15731:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787360091.059532:0:15731:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff983d11452800 using connection 192.168.201.114@tcp/0@lo 00000100:00100000:1.0:1787360091.059556:0:15731:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff983d3f98df80 x1874182527879296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787360091.059754:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527879168:0@lo:400:kworker.0 00000100:00100000:0.0:1787360091.059821:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360091.059882:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787360091.059887:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527879040:0@lo:400:kworker.0 00000100:00100000:0.0:1787360091.059910:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360091.059944:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879040 00000100:00100000:0.0:1787360091.059952:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879040 00000100:00100000:0.0:1787360091.059996:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787360091.060006:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3320:x1874182527879040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360091.060060:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3320:x1874182527879040:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360091.060067:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787360091.060308:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527879680:0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.060344:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360091.060373:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527879296:0@lo:8:kworker.0 00000100:00100000:2.0:1787360091.060400:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360091.060430:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879168 00000100:00100000:2.0:1787360091.060434:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879168 00000100:00100000:2.0:1787360091.060470:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879296 00000100:00100000:2.0:1787360091.060473:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879296 00000100:00100000:2.0:1787360091.060486:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360091.060493:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527879168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.060524:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527879168:12345-0@lo:400:kworker.0 Request processed in 32us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360091.060531:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787360091.060543:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360091.060547:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1874182527879296:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787360091.060574:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1787360091.060615:0:15146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x72f6de40e4ef49f3 00002000:00100000:2.0:1787360091.060634:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff983c023bf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787360091.060640:0:15146:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787360091.060651:0:15146:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787360091.061025:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787360091.061054:0:15146:0:(import.c:65:import_set_state_nolock()) ffff983c023bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360091.061511:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874182527879296:12345-0@lo:8:kworker.0 Request processed in 958us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360091.061520:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787360091.061556:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527879424:0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.061601:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360091.061625:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360091.061639:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527879552:0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.061660:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360091.061706:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879680 00000100:00100000:2.0:1787360091.061713:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879680 00000100:00100000:2.0:1787360091.061753:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879424 00000100:00100000:2.0:1787360091.061756:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879424 00000100:00100000:2.0:1787360091.061765:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879552 00000100:00100000:2.0:1787360091.061767:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879552 00000100:00100000:2.0:1787360091.061779:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787360091.061786:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527879680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.061824:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1874182527879680:12345-0@lo:400:kworker.0 Request processed in 38us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360091.061830:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787360091.061840:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360091.061845:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527879424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.061866:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527879424:12345-0@lo:400:kworker.0 Request processed in 21us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360091.061871:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787360091.061880:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360091.061895:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527879552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360091.061917:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527879552:12345-0@lo:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360091.061922:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787360091.061973:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f98df80 x1874182527879296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787360116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787360091.061990:0:3316:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787360091.061998:0:3316:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787360091.062003:0:3316:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787360091.062006:0:3316:0:(import.c:65:import_set_state_nolock()) ffff983d11452800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787360091.062022:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787360091.062029:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1874182527879296:0@lo:8:kworker.0 00010000:00080000:2.0:1787360091.062062:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f98ce00 x1874182527879680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360091.062071:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1874182527879680:0@lo:400:kworker.0 00010000:00080000:2.0:1787360091.062092:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f98d500 x1874182527879552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360091.062278:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527879040:0@lo:400:kworker.0 00000100:00100000:0.0:1787360091.062305:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527879168:0@lo:400:kworker.0 00000100:00080000:0.0:1787360091.062327:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787360091.062332:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787360091.062375:0:14490:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787360091.062393:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40994a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14490:1874182527879936:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787360091.062427:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360091.062445:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d136bd900 going to sleep for 11 seconds 00000004:00080000:0.0:1787360091.062461:0:14489:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787360091.062952:0:14489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 465391273713ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787360091.062978:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d40997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527879808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360091.063008:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360091.063047:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879808 00000100:00100000:0.0:1787360091.063053:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879808 00000100:00100000:0.0:1787360091.063094:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787360091.063243:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874182527879808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787360091.063276:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787360091.063321:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1874182527879808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360091.063334:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787360091.063357:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787360091.063384:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d40997800 x1874182527879808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787360107 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787360091.063400:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40997800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527879808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787360091.065726:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527879552:0@lo:400:kworker.0 00000100:00100000:0.0:1787360091.075048:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527879936 00000100:00100000:0.0:1787360091.075067:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527879936 00000100:00100000:0.0:1787360091.077317:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360091.077335:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14490:x1874182527879936:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1787360091.078920:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff983d3f98d180 x1874182527879424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787360107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787360091.078940:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527879424:0@lo:400:kworker.0 00002000:00080000:0.0:1787360091.092570:0:15148:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787360091.092584:0:15148:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787360091.092591:0:15148:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787360091.106712:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.106740:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.106762:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.106769:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.106777:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.106797:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.106810:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.106819:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.106913:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787360091.107458:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.107465:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.107485:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.107488:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.107493:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.107502:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.107510:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.107517:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.114925:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360091.114943:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.114973:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.114979:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.114993:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115022:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115030:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4bc07d2/0x72f6de40e4ef49fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115074:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.115078:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115084:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.115087:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115095:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115181:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.115196:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.115198:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.115200:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360091.115359:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787360091.115368:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f1af31e/0x72f6de40e4ef4a01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.115700:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787360091.116399:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.116406:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.116419:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.116423:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.116428:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.116447:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.116455:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.116459:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.116893:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787360091.117450:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.117458:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.117471:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.117473:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.117478:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.117487:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.117495:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.117512:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.119783:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787360091.120195:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787360091.120204:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120218:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360091.120223:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120241:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120267:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120274:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb9929a/0x72f6de40e4ef4a08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120293:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360091.120297:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120304:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360091.120307:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120315:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120324:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120331:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001acbb18/0x72f6de40e4ef4a0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.120352:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.120353:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.120355:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787360091.120381:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.120388:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120399:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.120403:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.120409:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120420:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120428:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120434:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120445:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787360091.120849:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.120855:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120869:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.120872:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.120875:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120885:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120893:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120900:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.120917:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787360091.121293:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.121299:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121307:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.121311:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.121315:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121325:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121343:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121350:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121358:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000040:00080000:1.0:1787360091.121604:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00002000:00010000:0.0:1787360091.121740:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787360091.121746:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121754:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1787360091.121757:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360091.121760:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121767:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121774:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121780:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.121798:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1787360091.122225:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787360091.122233:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.122241:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.122245:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.122253:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.122268:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.122274:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4fe743d/0x72f6de40e4ef4a16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122462:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787360091.122468:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122475:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360091.122478:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122485:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122497:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122504:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091de9227/0x72f6de40e4ef4a1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122518:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787360091.122521:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122527:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360091.122530:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122548:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122557:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122563:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f96db4/0x72f6de40e4ef4a24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122575:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360091.122578:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122584:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360091.122586:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122593:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122600:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122606:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85a4b07/0x72f6de40e4ef4a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122627:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.122628:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.122629:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.122727:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.122730:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.122731:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.122809:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.122815:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122822:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.122825:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.122830:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122838:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122846:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122853:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.122879:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360091.123297:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.123303:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123320:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.123322:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.123326:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123335:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123341:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123349:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123363:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787360091.123906:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.123914:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123924:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.123926:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.123931:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123940:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123960:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123968:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.123976:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787360091.124349:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.124354:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124360:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.124362:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.124365:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124371:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124376:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124380:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124392:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787360091.124654:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.124658:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124664:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.124665:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.124668:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124674:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.124715:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124766:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787360091.124774:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124783:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360091.124788:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124797:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124815:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124823:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004585878e/0x72f6de40e4ef4a32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124839:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787360091.124843:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124849:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360091.124852:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124871:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124881:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124887:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041f72625/0x72f6de40e4ef4a39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124899:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360091.124902:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124908:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360091.124911:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124919:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124928:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124934:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064d5053/0x72f6de40e4ef4a40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124957:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360091.124960:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124966:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360091.124969:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124976:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.124985:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.125080:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000412bf30b/0x72f6de40e4ef4a47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360091.125175:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360091.125177:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360091.125179:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.125270:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787360091.127143:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787360091.131822:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.131991:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787360091.132007:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360091.132013:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132022:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360091.132034:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132046:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132069:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132077:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f663adb3/0x72f6de40e4ef4a4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132101:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.132103:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.132104:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.132799:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.132809:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132824:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.132829:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.132837:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132850:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132860:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132875:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.132898:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.133189:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.133197:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133212:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.133217:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133225:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133238:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133246:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e6c863/0x72f6de40e4ef4a55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133262:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.133264:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.133266:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.133284:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.133290:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133298:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.133301:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.133306:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133315:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133323:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133331:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133354:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.133432:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.133438:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133446:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.133449:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133457:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133475:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133482:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004db14413/0x72f6de40e4ef4a5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.133497:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.133499:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.133501:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.133791:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.133798:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133813:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.133816:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.133821:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133830:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133837:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133844:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.133865:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.134077:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.134081:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134089:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.134092:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134179:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134192:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134199:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f372b14/0x72f6de40e4ef4a63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134225:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.134227:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.134229:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.134243:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.134249:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134257:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.134261:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.134265:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134274:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134299:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134307:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134325:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.134351:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.134356:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134363:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.134367:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134374:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134386:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134393:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0496527/0x72f6de40e4ef4a6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.134406:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.134407:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.134409:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.134780:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.134786:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134795:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.134797:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.134801:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134810:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134818:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134824:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.134855:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.135187:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.135192:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135210:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c2a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.135213:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135221:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360091.135230:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360091.135233:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135235:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135241:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f10d4b92/0x72f6de40e4ef4a71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135244:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.135247:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.135251:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135256:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.135257:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.135259:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.135259:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135266:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135273:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135293:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360091.135660:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787360091.135666:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787360091.135666:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135671:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135695:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1787360091.135700:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.135704:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135704:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.135709:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135712:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135730:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135738:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135739:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135746:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135747:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e6a8ad7/0x72f6de40e4ef4a78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135761:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.135764:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.135765:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787360091.135770:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165ae00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.135773:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135780:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135789:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135796:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000385776ad/0x72f6de40e4ef4a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.135808:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.135809:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.135815:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.135864:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.136147:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.136152:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136161:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.136163:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.136167:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136176:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136183:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136196:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136216:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787360091.136595:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.136601:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136609:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.136612:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.136616:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136625:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136633:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136640:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.136659:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787360091.136663:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787360091.136667:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136704:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165b400 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.136708:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136727:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136739:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136747:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9a7256a/0x72f6de40e4ef4a86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136761:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.136764:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136770:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165be00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.136772:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136779:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136795:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136802:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003880af1f/0x72f6de40e4ef4a8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.136814:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.136816:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.136817:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.136883:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.137314:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.137320:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137335:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.137338:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.137343:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137351:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137359:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137365:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137388:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.137670:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.137697:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.137706:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165b800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.137710:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.137728:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.137742:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.137749:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070633a9b/0x72f6de40e4ef4a94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.137776:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.137778:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.137780:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.137797:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.137803:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137811:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.137814:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.137818:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137827:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137846:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137853:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.137871:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360091.138181:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360091.138188:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138196:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165aa00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360091.138200:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138207:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138219:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138226:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2fd14f2/0x72f6de40e4ef4a9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360091.138236:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787360091.138240:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.138241:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138242:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.138244:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360091.138249:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.138252:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.138257:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138266:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138272:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138279:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138308:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787360091.138453:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787360091.138457:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.138466:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360091.138469:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.138476:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.138487:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.138495:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf8d5788/0x72f6de40e4ef4aa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360091.138508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.138510:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787360091.138511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.138701:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.138707:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138727:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.138730:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.138735:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138745:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138753:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138760:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.138778:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360091.138821:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360091.138831:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138839:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360091.138842:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138849:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138860:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138867:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062a9c8e4/0x72f6de40e4ef4aa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.138880:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.138882:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.138884:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787360091.139168:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787360091.139174:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.139182:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1787360091.139191:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360091.139196:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.139206:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.139214:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.139221:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360091.139242:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787360091.139260:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787360091.139265:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.139273:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165b000 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360091.139276:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.139294:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.139305:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.139313:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051253797/0x72f6de40e4ef4ab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360091.139326:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.139328:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360091.139330:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787360091.139408:0:15148:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1787360091.139527:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14490:x1874182527879936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 62195us (77095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360091.139537:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787360091.139561:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d40994a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14490:1874182527879936:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787360091.139578:0:14490:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787360091.139644:0:14490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14490:1874182527880064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787360091.139700:0:14490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360091.139750:0:14490:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12d08000 going to sleep for 11 seconds 00000100:00100000:3.0:1787360091.139767:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880064 00000100:00100000:3.0:1787360091.139775:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880064 00000100:00100000:3.0:1787360091.139818:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360091.139827:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14490:x1874182527880064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787360091.139863:0:15149:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787360091.144795:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14490:x1874182527880064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4961us (5087us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787360091.144818:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360091.144889:0:14490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14490:1874182527880064:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787360091.144905:0:14490:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1787360091.160265:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787360091.622825:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787360091.680180:0:16221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg114-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787360092.648078:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360093.670851:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360094.276028:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.295021:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011072 00000100:00100000:0.0:1787360094.295046:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011072 00000100:00100000:0.0:1787360094.295113:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:0.0:1787360094.295142:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2361:x1874182509011072:12345-192.168.201.14@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787360094.295181:0:14459:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9368da36-bbfd-4d9d-8a37-d6c06d166ff1@192.168.201.14@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1787360094.295221:0:14459:0:(genops.c:1385:class_connect()) connect: client 9368da36-bbfd-4d9d-8a37-d6c06d166ff1, cookie 0x72f6de40e4ef4ab7 00000100:00080000:0.0:1787360094.295397:0:14459:0:(import.c:65:import_set_state_nolock()) ffff983d200ea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787360094.295511:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+5:2361:x1874182509011072:12345-192.168.201.14@tcp:250:mount.lustre.0 Request processed in 358us (19485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.295520:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 75 00000100:00100000:1.0:1787360094.312132:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.316543:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011200 00000100:00100000:2.0:1787360094.316559:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011200 00000100:00100000:2.0:1787360094.316657:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:2.0:1787360094.316699:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+5:13758:x1874182509011200:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787360094.316719:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360094.316750:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d411f9000/0x72f6de40e4ef4abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce881 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.316783:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d411f9000/0x72f6de40e4ef4abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce881 expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.316794:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d411f9000/0x72f6de40e4ef4abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce881 expref: 6 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.316804:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9000, rc 0) 00000100:00100000:2.0:1787360094.316884:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+6:13758:x1874182509011200:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 209us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.316892:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 76 00000100:00100000:0.0:1787360094.324775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.324883:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011328 00000100:00100000:2.0:1787360094.324896:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011328 00000100:00100000:2.0:1787360094.324966:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:2.0:1787360094.324977:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+6:13758:x1874182509011328:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787360094.325430:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+6:13758:x1874182509011328:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 453us (669us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787360094.325440:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 77 00000100:00100000:1.0:1787360094.334149:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.336822:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011456 00000100:00100000:0.0:1787360094.336840:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011456 00000100:00100000:1.0:1787360094.340139:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 78 00000100:00100000:1.0:1787360094.340156:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+6:13758:x1874182509011456:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787360094.340176:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360094.340198:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef4ac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce888 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360094.340249:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef4ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce888 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360094.340261:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165a000/0x72f6de40e4ef4ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce888 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360094.340270:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a000, rc 0) 00000100:00100000:1.0:1787360094.340351:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+7:13758:x1874182509011456:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 198us (6217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.340358:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 78 00000100:00100000:1.0:1787360094.344945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.345024:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011584 00000100:00100000:2.0:1787360094.345037:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011584 00000100:00100000:2.0:1787360094.345102:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:2.0:1787360094.345114:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+7:13758:x1874182509011584:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787360094.345508:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13758:x1874182509011584:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 384us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.345518:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 79 00000100:00100000:2.0:1787360094.350024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360094.353886:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011712 00000100:00100000:3.0:1787360094.353906:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011712 00000100:00100000:3.0:1787360094.353997:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:3.0:1787360094.354010:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13758:x1874182509011712:12345-192.168.201.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787360094.354870:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13758:x1874182509011712:12345-192.168.201.14@tcp:503:mount.lustre.0 Request processed in 856us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.354881:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 80 00000100:00100000:3.0:1787360094.360593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360094.360814:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011840 00000100:00100000:1.0:1787360094.360831:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011840 00000100:00100000:1.0:1787360094.360912:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:1.0:1787360094.360925:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13777:x1874182509011840:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360094.361642:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13777:x1874182509011840:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 716us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.361653:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 81 00000100:00100000:3.0:1787360094.389888:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.390069:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509011968 00000100:00100000:0.0:1787360094.390081:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509011968 00000100:00100000:0.0:1787360094.390152:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 82 00000100:00100000:0.0:1787360094.390165:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13777:x1874182509011968:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360094.390544:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13777:x1874182509011968:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 380us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.390554:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 82 00000100:00100000:2.0:1787360094.406953:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360094.407171:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012096 00000100:00100000:1.0:1787360094.407183:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012096 00000100:00100000:1.0:1787360094.407257:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 83 00000100:00100000:1.0:1787360094.407270:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+8:13758:x1874182509012096:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787360094.407292:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360094.407313:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef4acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce8b2 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360094.407388:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef4acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b2 expref: 9 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360094.407402:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165b800/0x72f6de40e4ef4acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b2 expref: 9 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360094.407415:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165b800, rc 0) 00000100:00100000:1.0:1787360094.407488:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+9:13758:x1874182509012096:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 221us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.407496:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 83 00000100:00100000:3.0:1787360094.414489:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.414721:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012224 00000100:00100000:2.0:1787360094.414738:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012224 00000100:00100000:2.0:1787360094.414813:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:2.0:1787360094.414825:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+9:13758:x1874182509012224:12345-192.168.201.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787360094.414857:0:14460:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787360094.414891:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787360094.414896:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787360094.414901:0:14460:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787360094.414904:0:14460:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787360094.418306:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+9:13758:x1874182509012224:12345-192.168.201.14@tcp:256:mount.lustre.0 Request processed in 3467us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.418336:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 84 00000100:00100000:3.0:1787360094.426285:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.426410:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012352 00000100:00100000:0.0:1787360094.426422:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012352 00000100:00100000:0.0:1787360094.426489:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:0.0:1787360094.426500:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0246d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+9:13758:x1874182509012352:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360094.426519:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360094.426550:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce8b9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360094.426585:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 10 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360094.426616:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 10 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360094.426627:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41c00, rc 0) 00000100:00100000:0.0:1787360094.426750:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0246d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13758:x1874182509012352:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 251us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.426758:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 85 00000100:00100000:3.0:1787360094.437807:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.437946:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012480 00000100:00100000:2.0:1787360094.437959:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012480 00000100:00100000:2.0:1787360094.438024:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 86 00000100:00100000:2.0:1787360094.438036:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13758:x1874182509012480:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787360094.438408:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13758:x1874182509012480:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 372us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.438417:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 86 00000100:00100000:3.0:1787360094.444813:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360094.444940:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012608 00000100:00100000:1.0:1787360094.444952:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012608 00000100:00100000:1.0:1787360094.445023:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 87 00000100:00100000:1.0:1787360094.445035:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13758:x1874182509012608:12345-192.168.201.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787360094.445529:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13758:x1874182509012608:12345-192.168.201.14@tcp:503:mount.lustre.0 Request processed in 494us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.445539:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 87 00000100:00100000:3.0:1787360094.449145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.449332:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012736 00000100:00100000:0.0:1787360094.449343:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012736 00000100:00100000:0.0:1787360094.449403:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 88 00000100:00100000:0.0:1787360094.449415:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13782:x1874182509012736:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360094.450034:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13782:x1874182509012736:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 619us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.450043:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 88 00000100:00100000:3.0:1787360094.454477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.454657:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012864 00000100:00100000:2.0:1787360094.454714:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012864 00000100:00100000:2.0:1787360094.454791:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 89 00000100:00100000:2.0:1787360094.454803:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2757a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13782:x1874182509012864:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360094.455119:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2757a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13782:x1874182509012864:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 317us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.455128:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 89 00000100:00100000:3.0:1787360094.466126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.466523:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509012992 00000100:00100000:2.0:1787360094.466546:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509012992 00000100:00100000:2.0:1787360094.466604:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787360094.466614:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874182509012992:12345-192.168.201.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787360094.466653:0:14465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0e8b748a-0492-40f2-a25b-11c67731819d@192.168.201.14@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1787360094.466932:0:14465:0:(genops.c:1385:class_connect()) connect: client 0e8b748a-0492-40f2-a25b-11c67731819d, cookie 0x72f6de40e4ef4ada 00000004:00100000:2.0:1787360094.466975:0:14465:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787360094.466983:0:14465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787360094.509880:0:14465:0:(import.c:65:import_set_state_nolock()) ffff983d0dcfd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360094.510067:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+6:2361:x1874182509012992:12345-192.168.201.14@tcp:38:mount.lustre.0 Request processed in 43451us (43954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.510079:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:3.0:1787360094.516548:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360094.516735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.516915:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013120 00000100:00100000:0.0:1787360094.516928:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013120 00000100:00100000:0.0:1787360094.517022:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013248 00000100:00100000:0.0:1787360094.517025:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013248 00000100:00100000:0.0:1787360094.517047:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:0.0:1787360094.517058:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+7:0:x1874182509013120:12345-192.168.201.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360094.517112:0:14467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787360094.517237:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+7:0:x1874182509013120:12345-192.168.201.14@tcp:41:mount.lustre.0 Request processed in 180us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.517244:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:0.0:1787360094.517263:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:0.0:1787360094.517285:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:13758:x1874182509013248:12345-192.168.201.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360094.517298:0:14467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787360094.517324:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:13758:x1874182509013248:12345-192.168.201.14@tcp:41:mount.lustre.0 Request processed in 41us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.517330:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00080000:1.0:1787360094.517771:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360094.519457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.519558:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013376 00000100:00100000:0.0:1787360094.519568:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013376 00000100:00100000:0.0:1787360094.519618:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360094.519626:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:13758:x1874182509013376:12345-192.168.201.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787360094.519769:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:13758:x1874182509013376:12345-192.168.201.14@tcp:40:mount.lustre.0 Request processed in 142us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360094.519778:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360094.522023:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.522252:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360094.522611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.522834:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013760 00000100:00100000:2.0:1787360094.522844:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013760 00000100:00100000:2.0:1787360094.522902:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:2.0:1787360094.522912:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e8b748a-0492-40f2-a25b-11c67731819d+6:13758:x1874182509013760:12345-192.168.201.14@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787360094.523842:0:14468:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 836us 00000100:00100000:1.0:1787360094.527010:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013504 00000100:00100000:1.0:1787360094.527025:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013504 00000100:00100000:1.0:1787360094.527096:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013632 00000100:00100000:1.0:1787360094.527099:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013632 00000100:00100000:1.0:1787360094.527122:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787360094.527133:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182509013504:12345-192.168.201.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360094.527749:0:15148:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0e8b748a-0492-40f2-a25b-11c67731819d@192.168.201.14@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1787360094.527805:0:15148:0:(genops.c:1385:class_connect()) connect: client 0e8b748a-0492-40f2-a25b-11c67731819d, cookie 0x72f6de40e4ef4ae1 00002000:00100000:1.0:1787360094.527822:0:15148:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0e8b748a-0492-40f2-a25b-11c67731819d/ffff983d3f63c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360094.527853:0:15148:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360094.528376:0:15148:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787360094.528423:0:15148:0:(import.c:65:import_set_state_nolock()) ffff983d3f63a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360094.528599:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40997800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+6:2361:x1874182509013504:12345-192.168.201.14@tcp:8:mount.lustre.0 Request processed in 1464us (6590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.528611:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787360094.528642:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:1.0:1787360094.528648:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874182509013632:12345-192.168.201.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787360094.528699:0:15148:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0e8b748a-0492-40f2-a25b-11c67731819d@192.168.201.14@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1787360094.528728:0:15148:0:(genops.c:1385:class_connect()) connect: client 0e8b748a-0492-40f2-a25b-11c67731819d, cookie 0x72f6de40e4ef4ae8 00002000:00100000:1.0:1787360094.528735:0:15148:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0e8b748a-0492-40f2-a25b-11c67731819d/ffff983d3f63e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787360094.528752:0:15148:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787360094.528909:0:15148:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787360094.528945:0:15148:0:(import.c:65:import_set_state_nolock()) ffff983d3f63f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787360094.528971:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+6:2361:x1874182509013632:12345-192.168.201.14@tcp:8:mount.lustre.0 Request processed in 322us (6720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360094.528978:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000004:00200000:2.0:1787360094.554279:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787360094.554625:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e8b748a-0492-40f2-a25b-11c67731819d+6:13758:x1874182509013760:12345-192.168.201.14@tcp:33:mount.lustre.0 Request processed in 31705us (32004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.554638:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:2.0:1787360094.631167:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360094.631257:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360094.631452:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880192 00000100:00100000:3.0:1787360094.631461:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880192 00000100:00100000:3.0:1787360094.631531:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787360094.631540:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527880192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360094.631565:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787360094.631615:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527880192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360094.631623:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787360094.631691:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360094.631763:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360094.689938:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360094.690058:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509013888 00000100:00100000:2.0:1787360094.690070:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509013888 00000100:00100000:2.0:1787360094.690139:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:2.0:1787360094.690151:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+6:13803:x1874182509013888:12345-192.168.201.14@tcp:101:mkdir.0 00010000:00010000:2.0:1787360094.690176:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360094.690208:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9400/0x72f6de40e4ef4aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce8e3 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.690291:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4af6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.690306:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.690323:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360094.690613:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787360094.690618:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360094.690775:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.690810:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9400/0x72f6de40e4ef4aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8e3 expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.690833:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4af6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8e3 expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360094.690843:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:2.0:1787360094.690854:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360094.690859:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9a00, rc 0) 00000100:00100000:2.0:1787360094.690954:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+7:13803:x1874182509013888:12345-192.168.201.14@tcp:101:mkdir.0 Request processed in 804us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360094.690962:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00010000:00010000:3.0:1787360094.694934:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360095.718850:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360096.167151:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527880320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360096.167262:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360096.167398:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880320 00000100:00100000:3.0:1787360096.167408:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880320 00000100:00100000:3.0:1787360096.167492:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787360096.167518:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527880320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360096.167560:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787360096.167614:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527880320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360096.167621:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787360096.167744:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360096.167786:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527880320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360096.169106:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527880448:0@lo:400:kworker.0 00000100:00100000:0.0:1787360096.169198:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360096.169481:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880448 00000100:00100000:1.0:1787360096.169489:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880448 00000100:00100000:1.0:1787360096.169768:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787360096.169778:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3319:x1874182527880448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.169834:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3319:x1874182527880448:12345-0@lo:400:kworker.0 Request processed in 57us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360096.169855:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787360096.169917:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527880576:0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.169952:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360096.169989:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360096.169996:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527880960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360096.170015:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527880704:0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.170030:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360096.170054:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360096.170060:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880576 00000100:00100000:1.0:1787360096.170064:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880576 00000100:00100000:3.0:1787360096.170083:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787360096.170089:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527880832:0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.170102:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787360096.170110:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527880576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360096.170125:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360096.170145:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527880576:12345-0@lo:400:kworker.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360096.170151:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787360096.170157:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880960 00000100:00100000:3.0:1787360096.170161:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880960 00000100:00080000:1.0:1787360096.170167:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787360096.170196:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527880576:0@lo:400:kworker.0 00000100:00100000:3.0:1787360096.170211:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880704 00000100:00080000:1.0:1787360096.170223:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360096.170233:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527880832 00000100:00100000:1.0:1787360096.170236:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880832 00000100:00100000:1.0:1787360096.170260:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360096.170267:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527880960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.170304:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527880960:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360096.170311:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787360096.170325:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787360096.170331:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527880832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360096.170475:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527880448:0@lo:400:kworker.0 00000100:00100000:3.0:1787360096.170985:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527880704 00000100:00100000:2.0:1787360096.171215:0:14466:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787360096.171226:0:14466:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787360096.171351:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787360096.173109:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527880704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.173657:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874182527880832:12345-0@lo:400:kworker.0 Request processed in 2018us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360096.173669:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787360096.173721:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360096.173798:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1874182527880832:0@lo:400:kworker.0 00000100:00100000:1.0:1787360096.173841:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527880960:0@lo:400:kworker.0 00000100:00100000:3.0:1787360096.177084:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527880704:12345-0@lo:400:kworker.0 Request processed in 3980us (7012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360096.177103:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787360096.177262:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527880704:0@lo:400:kworker.0 00000001:00100000:0.0:1787360096.289741:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0e8b748a-0492-40f2-a25b-11c67731819d 00000001:00080000:0.0:1787360096.289876:0:7649:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:3.0:1787360096.722782:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360096.723019:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014016 00000100:00100000:0.0:1787360096.723033:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014016 00000100:00100000:0.0:1787360096.723134:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:0.0:1787360096.723147:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+7:13855:x1874182509014016:12345-192.168.201.14@tcp:41:lfs.0 00000004:00000024:0.0:1787360096.723209:0:14467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787360096.723313:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+7:13855:x1874182509014016:12345-192.168.201.14@tcp:41:lfs.0 Request processed in 168us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360096.723322:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00080000:1.0:1787360096.724382:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360096.728897:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360096.729077:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014144 00000100:00100000:0.0:1787360096.729090:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014144 00000100:00100000:0.0:1787360096.729249:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:0.0:1787360096.729262:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e8b748a-0492-40f2-a25b-11c67731819d+6:13855:x1874182509014144:12345-192.168.201.14@tcp:13:lfs.0 00002000:00000024:0.0:1787360096.729309:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787360096.729405:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e8b748a-0492-40f2-a25b-11c67731819d+6:13855:x1874182509014144:12345-192.168.201.14@tcp:13:lfs.0 Request processed in 145us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360096.729414:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00080000:1.0:1787360096.729698:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787360096.739271:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360096.740654:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014272 00000100:00100000:0.0:1787360096.740673:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014272 00000100:00100000:2.0:1787360096.740937:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:2.0:1787360096.740951:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e8b748a-0492-40f2-a25b-11c67731819d+5:13855:x1874182509014272:12345-192.168.201.14@tcp:13:lfs.0 00002000:00000024:2.0:1787360096.740985:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360096.741088:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0e8b748a-0492-40f2-a25b-11c67731819d+5:13855:x1874182509014272:12345-192.168.201.14@tcp:13:lfs.0 Request processed in 139us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360096.741097:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00080000:1.0:1787360096.741490:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787360096.745759:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360096.981272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360096.981457:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014400 00000100:00100000:0.0:1787360096.981470:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014400 00000100:00100000:0.0:1787360096.981555:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 91 00000100:00100000:0.0:1787360096.981576:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+10:13891:x1874182509014400:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787360096.981597:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360096.981648:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef4afd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce8ea expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360096.981734:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef4afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8ea expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360096.981748:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40a00/0x72f6de40e4ef4afd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8ea expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360096.981758:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40a00, rc 0) 00000100:00100000:0.0:1787360096.981827:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13891:x1874182509014400:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 253us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360096.981835:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 91 00000100:00100000:3.0:1787360096.984368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360096.988764:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014528 00000100:00100000:1.0:1787360096.988783:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014528 00000100:00100000:1.0:1787360096.989074:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 92 00000100:00100000:1.0:1787360096.989086:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13891:x1874182509014528:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787360096.989441:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13891:x1874182509014528:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 356us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360096.989451:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 92 00000100:00100000:3.0:1787360096.991789:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360097.010868:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014656 00000100:00100000:2.0:1787360097.010889:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014656 00000100:00100000:2.0:1787360097.011878:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 93 00000100:00100000:2.0:1787360097.011896:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13891:x1874182509014656:12345-192.168.201.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787360097.013631:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13891:x1874182509014656:12345-192.168.201.14@tcp:503:mount.lustre.0 Request processed in 1721us (21830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.013645:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 93 00000100:00100000:3.0:1787360097.024982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360097.025246:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014784 00000100:00100000:0.0:1787360097.025259:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014784 00000100:00100000:0.0:1787360097.025336:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:0.0:1787360097.025349:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13895:x1874182509014784:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360097.025823:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13895:x1874182509014784:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 475us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360097.025833:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 94 00000100:00100000:3.0:1787360097.058794:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360097.059018:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509014912 00000100:00100000:2.0:1787360097.059031:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509014912 00000100:00100000:2.0:1787360097.059090:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00100000:2.0:1787360097.059117:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13895:x1874182509014912:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787360097.059405:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13895:x1874182509014912:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 290us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.059414:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 95 00000100:00100000:3.0:1787360097.071390:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.071578:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015040 00000100:00100000:1.0:1787360097.071591:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015040 00000100:00100000:1.0:1787360097.071726:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 96 00000100:00100000:1.0:1787360097.071738:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13891:x1874182509015040:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787360097.071760:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360097.071781:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef4b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce914 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360097.071834:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef4b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce914 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360097.071848:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d0165b400/0x72f6de40e4ef4b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce914 expref: 12 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360097.071858:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165b400, rc 0) 00000100:00100000:1.0:1787360097.072066:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13891:x1874182509015040:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 329us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360097.072073:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 96 00000100:00100000:3.0:1787360097.089849:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360097.090157:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015168 00000100:00100000:0.0:1787360097.090172:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015168 00000100:00100000:0.0:1787360097.090245:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 97 00000100:00100000:0.0:1787360097.090256:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13891:x1874182509015168:12345-192.168.201.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787360097.090291:0:14458:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787360097.090325:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787360097.090330:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787360097.090333:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787360097.090341:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787360097.094284:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13891:x1874182509015168:12345-192.168.201.14@tcp:256:mount.lustre.0 Request processed in 4008us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360097.094304:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 97 00000100:00100000:3.0:1787360097.100033:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360097.100471:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015296 00000100:00100000:2.0:1787360097.100547:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015296 00000100:00100000:2.0:1787360097.101457:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 98 00000100:00100000:2.0:1787360097.101473:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13891:x1874182509015296:12345-192.168.201.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787360097.101986:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360097.102010:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce91b expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360097.102049:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360097.102063:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 13 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360097.102074:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9e00, rc 0) 00000100:00100000:2.0:1787360097.102161:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13891:x1874182509015296:12345-192.168.201.14@tcp:101:mount.lustre.0 Request processed in 692us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.102169:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 98 00000100:00100000:3.0:1787360097.105305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360097.105547:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015424 00000100:00100000:0.0:1787360097.105559:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015424 00000100:00100000:0.0:1787360097.105936:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00100000:0.0:1787360097.105952:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13891:x1874182509015424:12345-192.168.201.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787360097.106381:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13891:x1874182509015424:12345-192.168.201.14@tcp:501:mount.lustre.0 Request processed in 430us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360097.106390:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 99 00000100:00100000:3.0:1787360097.109218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360097.110120:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015552 00000100:00100000:2.0:1787360097.110133:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015552 00000100:00100000:2.0:1787360097.110210:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 100 00000100:00100000:2.0:1787360097.110222:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13891:x1874182509015552:12345-192.168.201.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787360097.110634:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13891:x1874182509015552:12345-192.168.201.14@tcp:503:mount.lustre.0 Request processed in 411us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.110652:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 100 00000100:00100000:3.0:1787360097.118221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.118347:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015680 00000100:00100000:1.0:1787360097.118359:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015680 00000100:00100000:1.0:1787360097.118428:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 101 00000100:00100000:1.0:1787360097.118439:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13900:x1874182509015680:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787360097.118883:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13900:x1874182509015680:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 443us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360097.118893:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 101 00000100:00100000:3.0:1787360097.124049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360097.124242:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015808 00000100:00100000:0.0:1787360097.124255:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015808 00000100:00100000:0.0:1787360097.124327:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 102 00000100:00100000:0.0:1787360097.124338:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13900:x1874182509015808:12345-192.168.201.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787360097.124738:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13900:x1874182509015808:12345-192.168.201.14@tcp:502:llog_process_th.0 Request processed in 401us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360097.124747:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 102 00000100:00100000:3.0:1787360097.129381:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360097.129492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.146031:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.146098:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.146139:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016320 00000100:00100000:1.0:1787360097.146149:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016320 00000100:00100000:1.0:1787360097.146204:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016192 00000100:00100000:1.0:1787360097.146208:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016192 00000100:00100000:1.0:1787360097.146227:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:1.0:1787360097.146237:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+5:2362:x1874182509016320:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360097.146331:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+5:2362:x1874182509016320:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 94us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360097.146359:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:1.0:1787360097.146380:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:1.0:1787360097.146387:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:2362:x1874182509016192:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360097.146416:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:2362:x1874182509016192:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 30us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360097.146422:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787360097.147777:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509015936 00000100:00100000:2.0:1787360097.147791:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509015936 00000100:00100000:2.0:1787360097.147848:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016064 00000100:00100000:2.0:1787360097.147852:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016064 00000100:00100000:2.0:1787360097.147910:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787360097.147922:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2362:x1874182509016064:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:2.0:1787360097.148001:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2362:x1874182509016064:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 82us (18508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.148009:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787360097.148029:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:2.0:1787360097.148034:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2361:x1874182509015936:12345-192.168.201.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787360097.148064:0:16338:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6949df5b-9793-423b-8f61-49e185cfa20a@192.168.201.14@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1787360097.148118:0:16338:0:(genops.c:1385:class_connect()) connect: client 6949df5b-9793-423b-8f61-49e185cfa20a, cookie 0x72f6de40e4ef4b12 00000004:00100000:2.0:1787360097.148164:0:16338:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787360097.148322:0:16338:0:(import.c:65:import_set_state_nolock()) ffff983c023bc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787360097.148359:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+6:2361:x1874182509015936:12345-192.168.201.14@tcp:38:mount.lustre.0 Request processed in 324us (18995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.148367:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:1.0:1787360097.156555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360097.161815:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016576 00000100:00100000:2.0:1787360097.161836:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016576 00000100:00100000:2.0:1787360097.161964:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:2.0:1787360097.161977:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+6:13891:x1874182509016576:12345-192.168.201.14@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787360097.162043:0:16338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787360097.162111:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360097.162154:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+6:13891:x1874182509016576:12345-192.168.201.14@tcp:41:mount.lustre.0 Request processed in 178us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.162163:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:3.0:1787360097.163772:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360097.164063:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016448 00000100:00100000:0.0:1787360097.164076:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016448 00000100:00100000:0.0:1787360097.164149:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:0.0:1787360097.164160:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+6:0:x1874182509016448:12345-192.168.201.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787360097.164194:0:14467:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787360097.164280:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+6:0:x1874182509016448:12345-192.168.201.14@tcp:41:mount.lustre.0 Request processed in 122us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360097.164288:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:3.0:1787360097.171344:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360097.171484:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016704 00000100:00100000:2.0:1787360097.171496:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016704 00000100:00100000:2.0:1787360097.171564:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:2.0:1787360097.171889:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6949df5b-9793-423b-8f61-49e185cfa20a+6:13891:x1874182509016704:12345-192.168.201.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787360097.172052:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6949df5b-9793-423b-8f61-49e185cfa20a+6:13891:x1874182509016704:12345-192.168.201.14@tcp:40:mount.lustre.0 Request processed in 375us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360097.172061:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:1.0:1787360097.181366:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.181488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360097.181530:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360097.182983:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016832 00000100:00100000:3.0:1787360097.183001:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016832 00000100:00100000:3.0:1787360097.183061:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509016960 00000100:00100000:3.0:1787360097.183064:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509016960 00000100:00100000:3.0:1787360097.183083:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:3.0:1787360097.183094:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874182509016832:12345-192.168.201.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787360097.183145:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6949df5b-9793-423b-8f61-49e185cfa20a@192.168.201.14@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:3.0:1787360097.183181:0:15146:0:(genops.c:1385:class_connect()) connect: client 6949df5b-9793-423b-8f61-49e185cfa20a, cookie 0x72f6de40e4ef4b19 00002000:00100000:3.0:1787360097.183193:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6949df5b-9793-423b-8f61-49e185cfa20a/ffff983d0dcfb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787360097.183204:0:15146:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787360097.183326:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787360097.183365:0:15146:0:(import.c:65:import_set_state_nolock()) ffff983d39cdd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360097.183439:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6949df5b-9793-423b-8f61-49e185cfa20a+6:2361:x1874182509016832:12345-192.168.201.14@tcp:8:mount.lustre.0 Request processed in 344us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360097.183447:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:3.0:1787360097.183465:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:3.0:1787360097.183470:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874182509016960:12345-192.168.201.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787360097.183484:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6949df5b-9793-423b-8f61-49e185cfa20a@192.168.201.14@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:3.0:1787360097.183502:0:15146:0:(genops.c:1385:class_connect()) connect: client 6949df5b-9793-423b-8f61-49e185cfa20a, cookie 0x72f6de40e4ef4b20 00002000:00100000:3.0:1787360097.183507:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6949df5b-9793-423b-8f61-49e185cfa20a/ffff983d39cd8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787360097.183512:0:15146:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787360097.184021:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787360097.184039:0:15146:0:(import.c:65:import_set_state_nolock()) ffff983d39cdf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787360097.184068:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6949df5b-9793-423b-8f61-49e185cfa20a+6:2361:x1874182509016960:12345-192.168.201.14@tcp:8:mount.lustre.0 Request processed in 597us (2537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360097.184075:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:1.0:1787360097.189090:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017088 00000100:00100000:1.0:1787360097.189108:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017088 00000100:00100000:1.0:1787360097.189189:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:1.0:1787360097.189201:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6949df5b-9793-423b-8f61-49e185cfa20a+6:13891:x1874182509017088:12345-192.168.201.14@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787360097.189519:0:14469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787360097.189971:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6949df5b-9793-423b-8f61-49e185cfa20a+6:13891:x1874182509017088:12345-192.168.201.14@tcp:33:mount.lustre.0 Request processed in 769us (8613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360097.189981:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:1.0:1787360097.432299:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360097.432451:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017216 00000100:00100000:0.0:1787360097.432463:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017216 00000100:00100000:0.0:1787360097.432528:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:0.0:1787360097.432538:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+6:13921:x1874182509017216:12345-192.168.201.14@tcp:101:mkdir.0 00010000:00010000:0.0:1787360097.432561:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360097.432593:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce945 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360097.432901:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360097.432919:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360097.432936:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360097.435303:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787360097.435317:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360097.438060:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360097.438134:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360097.438160:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360097.438172:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:0.0:1787360097.438176:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360097.438190:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41800, rc 0) 00000100:00100000:0.0:1787360097.438294:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+7:13921:x1874182509017216:12345-192.168.201.14@tcp:101:mkdir.0 Request processed in 5753us (6004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360097.438304:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00010000:00010000:3.0:1787360097.768518:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787360097.823617:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0e8b748a-0492-40f2-a25b-11c67731819d 00000001:00100000:1.0:1787360097.823642:0:6724:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6949df5b-9793-423b-8f61-49e185cfa20a 00010000:00010000:3.0:1787360098.790980:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787360099.752287:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787360099.752318:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787360099.752384:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360099.752432:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881088 00000100:00100000:3.0:1787360099.752796:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881088 00000100:00100000:3.0:1787360099.752877:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787360099.752888:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527881088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360099.752925:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787360099.752980:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e175c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527881088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360099.752987:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787360099.753132:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527881088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787360099.753264:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787360099.788178:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6949df5b-9793-423b-8f61-49e185cfa20a 00000001:00100000:1.0:1787360099.788198:0:5884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0e8b748a-0492-40f2-a25b-11c67731819d 00000001:02000400:2.0:1787360099.802504:0:16424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787360099.817869:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787360100.850172:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360101.291335:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527881216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360101.291408:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360101.294953:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881216 00000100:00100000:3.0:1787360101.294970:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881216 00000100:00100000:3.0:1787360101.295060:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787360101.295102:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527881216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787360101.295144:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787360101.295229:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527881216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360101.295237:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787360101.300137:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787360101.300840:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3318:1874182527881344:0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301040:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360101.301084:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527881856:0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301137:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360101.301165:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787360101.301171:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527881728:0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301195:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360101.301227:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881344 00000100:00100000:0.0:1787360101.301236:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881344 00000100:00100000:0.0:1787360101.301403:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360101.301414:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3318:x1874182527881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301476:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3318:x1874182527881344:12345-0@lo:400:kworker.0 Request processed in 63us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360101.301484:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787360101.301520:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881856 00000100:00100000:0.0:1787360101.301523:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881856 00000100:00100000:0.0:1787360101.301569:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881728 00000100:00100000:0.0:1787360101.301572:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881728 00000100:00100000:0.0:1787360101.301592:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360101.301598:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527881856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301637:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1874182527881856:12345-0@lo:400:kworker.0 Request processed in 39us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360101.301643:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787360101.301656:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787360101.301662:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527881728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301712:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1874182527881728:12345-0@lo:400:kworker.0 Request processed in 50us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360101.301718:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787360101.301741:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787360101.301779:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787360101.301806:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527881216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360101.301833:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1874182527881728:0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301843:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3318:1874182527881344:0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.301851:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1874182527881856:0@lo:400:kworker.0 00000100:00100000:2.0:1787360101.305896:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527881472:0@lo:400:kworker.0 00000100:00100000:2.0:1787360101.305977:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360101.306023:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787360101.306031:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527881600:0@lo:400:kworker.0 00000100:00100000:2.0:1787360101.306056:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360101.306212:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881472 00000100:00100000:1.0:1787360101.306222:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881472 00000100:00100000:1.0:1787360101.306305:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787360101.306317:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527881472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787360101.306384:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527881472:12345-0@lo:400:kworker.0 Request processed in 70us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360101.306392:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360101.309662:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527881600 00000100:00100000:0.0:1787360101.309694:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527881600 00000100:00100000:0.0:1787360101.309759:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787360101.309770:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527881600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360101.309861:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1874182527881600:12345-0@lo:400:kworker.0 Request processed in 93us (3803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360101.309869:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787360101.310117:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1874182527881600:0@lo:400:kworker.0 00000100:00100000:2.0:1787360101.310133:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527881472:0@lo:400:kworker.0 00000100:00080000:2.0:1787360101.310165:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787360101.353408:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1787360101.360101:0:7649:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6949df5b-9793-423b-8f61-49e185cfa20a 00010000:00010000:3.0:1787360101.862854:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360102.480651:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480813:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480863:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480884:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360102.480936:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017856 00000100:00100000:0.0:1787360102.480949:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017856 00000100:00100000:0.0:1787360102.481026:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017472 00000100:00100000:0.0:1787360102.481030:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017472 00000100:00100000:0.0:1787360102.481058:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:0.0:1787360102.481071:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+6:2363:x1874182509017856:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360102.481145:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+6:2363:x1874182509017856:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.481154:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:0.0:1787360102.481172:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:0.0:1787360102.481177:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:2363:x1874182509017472:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360102.481204:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+6:2363:x1874182509017472:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.481210:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:0.0:1787360102.481229:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017600 00000100:00100000:0.0:1787360102.481233:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017600 00000100:00100000:0.0:1787360102.481253:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018112 00000100:00100000:0.0:1787360102.481255:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018112 00000100:00100000:0.0:1787360102.481265:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017728 00000100:00100000:0.0:1787360102.481267:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017728 00000100:00100000:0.0:1787360102.481279:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017984 00000100:00100000:0.0:1787360102.481281:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017984 00000100:00100000:0.0:1787360102.481297:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:0.0:1787360102.481311:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e8b748a-0492-40f2-a25b-11c67731819d+5:2363:x1874182509017600:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360102.481338:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e8b748a-0492-40f2-a25b-11c67731819d+5:2363:x1874182509017600:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.481344:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:0.0:1787360102.481357:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360102.481364:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6949df5b-9793-423b-8f61-49e185cfa20a+5:2363:x1874182509018112:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360102.481387:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6949df5b-9793-423b-8f61-49e185cfa20a+5:2363:x1874182509018112:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.481393:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360102.481404:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:0.0:1787360102.481410:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e8b748a-0492-40f2-a25b-11c67731819d+5:2363:x1874182509017728:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360102.481431:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e8b748a-0492-40f2-a25b-11c67731819d+5:2363:x1874182509017728:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 21us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.481437:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:0.0:1787360102.481447:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:0.0:1787360102.481453:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6949df5b-9793-423b-8f61-49e185cfa20a+5:2363:x1874182509017984:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360102.481475:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6949df5b-9793-423b-8f61-49e185cfa20a+5:2363:x1874182509017984:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 23us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360102.481481:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00080000:0.0:1787360102.481498:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787360102.481502:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360102.481504:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787360102.481790:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509017344 00000100:00100000:1.0:1787360102.481796:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509017344 00000100:00100000:1.0:1787360102.481833:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 104 00000100:00100000:1.0:1787360102.481840:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:2363:x1874182509017344:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360102.481867:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:2363:x1874182509017344:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 28us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360102.481873:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 104 00010000:00010000:2.0:1787360102.889042:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787360103.387088:0:16574:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc904cc750 20000000:00000080:0.0:1787360103.387110:0:16574:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff983c01c2c000 uarg=0000000000000000 20000000:01000000:0.0:1787360103.387158:0:16574:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787360103.387165:0:16574:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787360103.387170:0:16574:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787360103.389008:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787360103.389207:0:16574:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787360103.395344:0:16574:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787360103.395668:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396301:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396310:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396317:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396326:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396344:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396353:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396426:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396443:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 12 pid: 14459 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.396460:0:16574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527881984:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360103.396658:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396668:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.396702:0:16574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882112:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360103.396739:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396748:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 18 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.396758:0:16574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882240:0@lo:104: 00000100:00100000:1.0:1787360103.396800:0:16574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360103.396849:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396857:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 18 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.396864:0:16574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882368:0@lo:104: 00000100:00100000:1.0:1787360103.396884:0:16574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787360103.396913:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.396921:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 18 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.396929:0:16574:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882496:0@lo:104: 00000100:00100000:1.0:1787360103.396951:0:16574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360103.396961:0:16574:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12f2a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360103.397144:0:14449:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787360103.397160:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527882240 00000100:00100000:0.0:1787360103.397168:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527882240 00000100:00100000:0.0:1787360103.397217:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527882368 00000100:00100000:0.0:1787360103.397219:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527882368 00000100:00100000:0.0:1787360103.397230:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527882496 00000100:00100000:0.0:1787360103.397232:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527882496 00000100:00100000:0.0:1787360103.397245:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360103.397255:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+5:16574:x1874182527882240:12345-0@lo:104: 00010000:00010000:0.0:1787360103.397269:0:14449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397340:0:14449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787360103.397346:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+5:16574:x1874182527882240:12345-0@lo:104: Request processed in 93us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.397353:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360103.397384:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360103.397391:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+4:16574:x1874182527882368:12345-0@lo:104: 00010000:00010000:0.0:1787360103.397399:0:14449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397436:0:14449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787360103.397441:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+4:16574:x1874182527882368:12345-0@lo:104: Request processed in 52us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.397458:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360103.397472:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360103.397478:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39db8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:16574:x1874182527882496:12345-0@lo:104: 00010000:00010000:0.0:1787360103.397486:0:14449:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397527:0:14449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787360103.397533:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39db8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+3:16574:x1874182527882496:12345-0@lo:104: Request processed in 56us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.397538:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787360103.397594:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787360103.397601:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397609:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d200c3a00 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360103.397614:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397624:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360103.397631:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360103.397636:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360103.397671:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397696:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360103.397725:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397733:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d200c3a00/0x72f6de40e4ef49ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef49b4 expref: -99 pid: 15865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397746:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787360103.397750:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397756:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62400 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360103.397759:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397766:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360103.397771:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360103.397776:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360103.397790:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397796:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360103.397802:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397808:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d25b62400/0x72f6de40e4ef4872 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef4879 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397827:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360103.397831:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397836:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62000 already unused, calling callback (ffffffffc1cc3c20) 10000000:00010000:0.0:1787360103.397838:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397845:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787360103.397851:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787360103.397856:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787360103.397871:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397876:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787360103.397891:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397898:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.114@tcp lock: ffff983d25b62000/0x72f6de40e4ef4825 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x72f6de40e4ef482c expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.397912:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360103.397914:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360103.397915:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360103.397940:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527882624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360103.397983:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360103.398007:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787360103.398013:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527882752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360103.398037:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360103.398068:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527882880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360103.398093:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360103.398125:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527882624 00000100:00100000:0.0:1787360103.398130:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527882624 00010000:00010000:0.0:1787360103.398152:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 19 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360103.398168:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527882752 00000100:00100000:0.0:1787360103.398171:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527882752 00010000:00010000:0.0:1787360103.398181:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 20 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360103.398189:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527882880 00000100:00100000:0.0:1787360103.398191:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527882880 00010000:00010000:0.0:1787360103.398198:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 21 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360103.398209:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360103.398215:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+21:3319:x1874182527882624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360103.398228:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360103.398235:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 21 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.398245:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 21 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.398276:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360103.398308:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+21:3319:x1874182527882624:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.398315:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787360103.398329:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360103.398336:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+20:3319:x1874182527882752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360103.398342:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360103.398347:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 20 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.398354:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 20 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.398363:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360103.398383:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+20:3319:x1874182527882752:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.398388:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787360103.398401:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360103.398407:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d415f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3317:x1874182527882880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787360103.398414:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360103.398418:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 19 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.398426:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 19 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.398435:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360103.398468:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d415f5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3317:x1874182527882880:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.398474:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787360103.398560:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3317:1874182527882880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360103.398587:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527882752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787360103.398593:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3319:1874182527882624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787360103.398816:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f40800/0x72f6de40e4ef49b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef49ad expref: 18 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.398827:0:16574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882240:0@lo:104: 00010000:00010000:1.0:1787360103.398837:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d25b62a00/0x72f6de40e4ef4879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef4872 expref: 17 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.398844:0:16574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882368:0@lo:104: 00010000:00010000:1.0:1787360103.398851:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f41200/0x72f6de40e4ef482c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x72f6de40e4ef4825 expref: 16 pid: 14460 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.398857:0:16574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882496:0@lo:104: 00010000:00010000:2.0:1787360103.399802:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360103.402518:0:16574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527881984:192.168.201.14@tcp:104: 00000100:00100000:1.0:1787360103.402555:0:16574:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1874182527882112:192.168.201.14@tcp:104: 00010000:00010000:1.0:1787360103.402599:0:16574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.403543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360103.403624:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018240 00000100:00100000:0.0:1787360103.403634:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018240 00010000:00010000:0.0:1787360103.403714:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 13 pid: 14459 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360103.403756:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360103.403767:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:2362:x1874182509018240:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360103.403785:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360103.403791:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 13 pid: 14459 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.403804:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 13 pid: 14459 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.403824:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d411f9e00/0x72f6de40e4ef4b0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce91b expref: 13 pid: 14459 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360103.403842:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360103.403895:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:2362:x1874182509018240:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360103.403903:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360103.411117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360103.411227:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018368 00000100:00100000:1.0:1787360103.411241:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018368 00010000:00010000:1.0:1787360103.411290:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360103.411338:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:1.0:1787360103.411349:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:2363:x1874182509018368:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360103.411381:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360103.411389:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411404:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411426:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983c02f41c00/0x72f6de40e4ef4ad3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8b9 expref: 12 pid: 14458 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411447:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411456:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411476:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411499:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411506:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411522:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411529:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165aa00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360103.411534:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411543:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411566:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.411578:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360103.411650:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:2363:x1874182509018368:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 301us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360103.411657:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00010000:00010000:2.0:1787360103.411831:0:16574:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360103.411840:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360103.411846:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff983d0165aa00/0x72f6de40e4ef4b35 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360103.915392:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787360104.654922:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360104.656961:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018496 00000100:00100000:0.0:1787360104.656976:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018496 00000100:00100000:0.0:1787360104.657050:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 105 00000100:00100000:0.0:1787360104.657062:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+11:13772:x1874182509018496:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787360104.657081:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360104.657104:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef4b3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce94c expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.657138:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef4b3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce94c expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.657152:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983c02f40200/0x72f6de40e4ef4b3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce94c expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360104.657164:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40200, rc 0) 00000100:00100000:0.0:1787360104.657229:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13772:x1874182509018496:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 169us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360104.657236:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 105 00000100:00100000:3.0:1787360104.662195:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360104.665850:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018624 00000100:00100000:2.0:1787360104.665870:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018624 00000100:00100000:2.0:1787360104.665943:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 106 00000100:00100000:2.0:1787360104.665956:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13772:x1874182509018624:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.666257:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13772:x1874182509018624:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 303us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.666267:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 106 00000100:00100000:1.0:1787360104.674985:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360104.675113:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018752 00000100:00100000:3.0:1787360104.675126:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018752 00000100:00100000:3.0:1787360104.675186:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 107 00000100:00100000:3.0:1787360104.675199:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13772:x1874182509018752:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360104.675543:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13772:x1874182509018752:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 344us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.675552:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 107 00000100:00100000:3.0:1787360104.686537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 10000000:01000000:2.0:1787360104.686939:0:14462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787360104.686944:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d03cf3000 from 10 10000000:01000000:2.0:1787360104.686948:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360104.687003:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.687015:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.687029:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360104.687067:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360104.687167:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509018880 00000100:00100000:3.0:1787360104.687176:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509018880 00000100:00100000:3.0:1787360104.687229:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 108 00000100:00100000:3.0:1787360104.687238:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+12:13772:x1874182509018880:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787360104.687252:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360104.687266:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef4b4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce953 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360104.687294:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef4b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce953 expref: 13 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360104.687307:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d25b63400/0x72f6de40e4ef4b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce953 expref: 13 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360104.687316:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63400, rc 0) 00000100:00100000:2.0:1787360104.693284:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.693360:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f8739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.694604:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883008 00000100:00100000:2.0:1787360104.694617:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883008 00000100:00100000:2.0:1787360104.694671:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787360104.694696:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+16:14462:x1874182527883008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360104.694716:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360104.694738:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d411f8c00/0x72f6de40e4ef4b51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4b43 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.694795:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d411f8c00/0x72f6de40e4ef4b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4b43 expref: 17 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.694809:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d411f8c00/0x72f6de40e4ef4b51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4b43 expref: 17 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.694819:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f8c00, rc 0) 00000100:00100000:2.0:1787360104.694896:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:14462:x1874182527883008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.694904:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787360104.694969:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360104.694989:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b51 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.694999:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4b51 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360104.695087:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.695122:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.695148:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f8739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.695158:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883136 00000100:00100000:2.0:1787360104.695162:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883136 00000100:00100000:2.0:1787360104.695178:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787360104.695184:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:14462:x1874182527883136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.695446:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:14462:x1874182527883136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.695454:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787360104.695482:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.695522:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.695557:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.695569:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f8739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.695580:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883264 00000100:00100000:2.0:1787360104.695583:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883264 00000100:00100000:2.0:1787360104.695599:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787360104.695604:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:14462:x1874182527883264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.695764:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:14462:x1874182527883264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.695771:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787360104.695804:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787360104.696474:0:16633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787360104.696552:0:14462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787360104.696568:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360104.696578:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b51 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.696588:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d411f9400/0x72f6de40e4ef4b43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b51 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787360104.696599:0:14462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787360104.696601:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d1101e800 from 10 10000000:01000000:2.0:1787360104.696605:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787360104.696645:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.696654:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.696663:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360104.696708:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.696755:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.696783:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f8739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.696799:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883392 00000100:00100000:2.0:1787360104.696803:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883392 00000100:00100000:2.0:1787360104.696831:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787360104.696839:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+17:14462:x1874182527883392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360104.696849:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360104.696862:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d411f9800/0x72f6de40e4ef4b5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4b58 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.696899:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d411f9800/0x72f6de40e4ef4b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4b58 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.696910:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d411f9800/0x72f6de40e4ef4b5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4b58 expref: 18 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.696919:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9800, rc 0) 00000100:00100000:2.0:1787360104.696951:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527883392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.696958:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787360104.696992:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360104.697004:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b5f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.697013:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4b5f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360104.697050:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.697069:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.697080:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.697089:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883520 00000100:00100000:2.0:1787360104.697092:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883520 00000100:00100000:2.0:1787360104.697105:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787360104.697110:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527883520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.697301:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527883520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.697316:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787360104.697340:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.697364:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.697400:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.697413:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d3f851540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.697424:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883648 00000100:00100000:2.0:1787360104.697427:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883648 00000100:00100000:2.0:1787360104.697442:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787360104.697447:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527883648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787360104.699564:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13772:x1874182509018880:12345-192.168.201.14@tcp:101:ll_cfg_requeue.0 Request processed in 12314us (13025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.699576:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 108 00000100:00100000:2.0:1787360104.701884:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527883648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4416us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.706910:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787360104.707849:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787360104.713248:0:16635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787360104.713535:0:14462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787360104.713558:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787360104.713627:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b5f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360104.713657:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d411f8800/0x72f6de40e4ef4b58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b5f expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787360104.713668:0:14462:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787360104.713671:0:14462:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff983d3f3a2800 from 10 10000000:01000000:1.0:1787360104.713673:0:14462:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:3.0:1787360104.713738:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360104.713815:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019008 00000100:00100000:3.0:1787360104.713826:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019008 00000100:00100000:3.0:1787360104.713875:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:3.0:1787360104.713887:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13772:x1874182509019008:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 00010000:00010000:1.0:1787360104.714112:0:14462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360104.714120:0:14462:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360104.714129:0:14462:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360104.714151:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787360104.714164:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13772:x1874182509019008:12345-192.168.201.14@tcp:501:ll_cfg_requeue.0 Request processed in 278us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.714172:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 115 00000100:00100000:1.0:1787360104.714193:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360104.714226:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12f2a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787360104.714321:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883776 00000100:00100000:2.0:1787360104.714325:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883776 00000100:00100000:2.0:1787360104.714363:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787360104.714370:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+18:14462:x1874182527883776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360104.714379:0:14460:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360104.714393:0:14460:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff983d411f8e00/0x72f6de40e4ef4b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x72f6de40e4ef4b66 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.714418:0:14460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff983d411f8e00/0x72f6de40e4ef4b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x72f6de40e4ef4b66 expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.714429:0:14460:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff983d411f8e00/0x72f6de40e4ef4b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x72f6de40e4ef4b66 expref: 19 pid: 14460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.714445:0:14460:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f8e00, rc 0) 00000100:00100000:2.0:1787360104.714477:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527883776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.714483:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787360104.714546:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787360104.714561:0:14462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b6d expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.714570:0:14462:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x72f6de40e4ef4b6d expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360104.714622:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.714646:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.714672:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360104.714942:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527883904 00000100:00100000:1.0:1787360104.714946:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527883904 00000100:00100000:1.0:1787360104.714980:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787360104.714986:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527883904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787360104.715137:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527883904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.715145:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787360104.715303:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527883904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.715334:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527884032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.715371:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360104.715398:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787360104.715429:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884032 00000100:00100000:1.0:1787360104.715433:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884032 00000100:00100000:1.0:1787360104.715462:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787360104.715474:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527884032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787360104.716152:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:14462:x1874182527884032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 675us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360104.716162:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787360104.717729:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:14462:1874182527884032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787360104.719915:0:16637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787360104.719972:0:14462:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787360104.719990:0:14462:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787360104.720003:0:14462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b6d expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360104.720026:0:14462:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.114@tcp lock: ffff983d0165b000/0x72f6de40e4ef4b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x72f6de40e4ef4b6d expref: -99 pid: 14462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360104.723990:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360104.724188:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019136 00000100:00100000:2.0:1787360104.724214:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019136 00000100:00100000:2.0:1787360104.724285:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 119 00000100:00100000:2.0:1787360104.724300:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d087c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13772:x1874182509019136:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787360104.724565:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d087c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:13772:x1874182509019136:12345-192.168.201.14@tcp:503:ll_cfg_requeue.0 Request processed in 269us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360104.724575:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 119 00000100:00100000:3.0:1787360104.872706:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527884160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787360104.872819:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360104.872909:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884160 00000100:00100000:3.0:1787360104.872918:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884160 00000100:00100000:3.0:1787360104.872981:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787360104.872992:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527884160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360104.873031:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787360104.873080:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527884160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360104.873088:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787360104.873345:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360104.873392:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527884160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787360104.936658:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787360105.960071:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360106.406970:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527884288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787360106.407060:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360106.407158:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884288 00000100:00100000:1.0:1787360106.407171:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884288 00000100:00100000:1.0:1787360106.407255:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787360106.407283:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527884288:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787360106.407335:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787360106.407577:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527884544:0@lo:400:kworker.0 00000100:00100000:2.0:1787360106.407615:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360106.407641:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787360106.407648:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527884672:0@lo:400:kworker.0 00000100:00100000:2.0:1787360106.407674:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360106.407768:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884672 00000100:00100000:3.0:1787360106.407774:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884672 00000100:00100000:2.0:1787360106.407779:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884544 00000100:00100000:2.0:1787360106.407785:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884544 00000100:00100000:3.0:1787360106.407812:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787360106.407822:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527884672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360106.407834:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787360106.407844:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527884544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.407881:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874182527884672:12345-0@lo:400:kworker.0 Request processed in 61us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360106.407889:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787360106.407894:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527884544:12345-0@lo:400:kworker.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360106.407903:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787360106.407929:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360106.407943:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e176a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874182527884672:0@lo:400:kworker.0 00000100:00100000:2.0:1787360106.407952:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527884416:0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.407957:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527884544:0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.407993:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527884800:0@lo:400:kworker.0 00000100:00100000:2.0:1787360106.408004:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360106.408039:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527884928:0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.408041:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360106.408074:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360106.408077:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884800 00000100:00100000:3.0:1787360106.408081:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884800 00000100:00100000:3.0:1787360106.408112:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884928 00000100:00100000:3.0:1787360106.408115:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884928 00000100:00100000:2.0:1787360106.408129:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787360106.408140:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527884800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.408147:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787360106.408157:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527884928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787360106.408188:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1874182527884800:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360106.408196:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787360106.408204:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527884928:12345-0@lo:400:kworker.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360106.408212:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787360106.408217:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787360106.408241:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527884928:0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.408251:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1874182527884800:0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.408286:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527884416 00000100:00100000:3.0:1787360106.408289:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527884416 00000100:00100000:3.0:1787360106.408313:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787360106.408319:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3320:x1874182527884416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360106.408639:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3320:x1874182527884416:12345-0@lo:400:kworker.0 Request processed in 319us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360106.408646:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787360106.409022:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527884416:0@lo:400:kworker.0 00002000:00000024:1.0:1787360106.410132:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787360106.410217:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1874182527884288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2949us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360106.410226:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787360106.410498:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1874182527884288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360106.511035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360106.511355:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019264 00000100:00100000:0.0:1787360106.511377:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019264 00000100:00100000:0.0:1787360106.511467:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:0.0:1787360106.511480:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+6:14431:x1874182509019264:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360106.511505:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.511537:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce95a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.511629:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.511643:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.511652:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.511662:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.511666:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.511670:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787360106.512281:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787360106.512583:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef4b89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512595:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef4b89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512602:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef4b89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.512695:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787360106.512698:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360106.512794:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef4b89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512808:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512813:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512818:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512822:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360106.512825:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512830:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512841:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:0.0:1787360106.512843:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.512847:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512851:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4b7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512859:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512863:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512867:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512873:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360106.512875:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512879:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512883:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff983d09750400) 00010000:00010000:0.0:1787360106.512885:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.512886:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512889:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4b82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512920:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce95a expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512930:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40800/0x72f6de40e4ef4b89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce95a expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.512934:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff983d09750600) 00010000:00010000:0.0:1787360106.512935:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360106.512937:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40800, rc 0) 00000100:00100000:0.0:1787360106.513354:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+7:14431:x1874182509019264:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 1875us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.513375:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:2.0:1787360106.538622:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.538894:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019520 00000100:00100000:3.0:1787360106.538910:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019520 00000100:00100000:3.0:1787360106.539000:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:3.0:1787360106.539013:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+7:14431:x1874182509019520:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360106.539052:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360106.539085:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4b90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce961 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.539196:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.539213:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.539249:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.540305:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.540338:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.540348:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.541140:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef4ba5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.541155:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef4ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.541163:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef4ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.541177:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787360106.543020:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.544303:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.544312:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.544384:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360106.544407:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.544416:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.545651:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff983d09750600) 00010000:00010000:3.0:1787360106.545659:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.545666:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546151:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4b97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546183:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546400:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546408:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546415:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360106.546420:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546427:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546462:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff983d0947c700) 00010000:00010000:3.0:1787360106.546466:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.546500:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.546506:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4b9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.558989:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4b90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce961 expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.559022:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62000/0x72f6de40e4ef4ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce961 expref: 9 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.559033:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d0947ce00) 00010000:00010000:3.0:1787360106.559036:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.559040:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62000, rc 0) 00000100:00100000:3.0:1787360106.559140:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+9:14431:x1874182509019520:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 20129us (20531us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787360106.559151:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:1.0:1787360106.566669:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.567258:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019648 00000100:00100000:3.0:1787360106.567272:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019648 00000100:00100000:3.0:1787360106.567370:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:3.0:1787360106.567384:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+9:14431:x1874182509019648:12345-192.168.201.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787360106.567544:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+9:14431:x1874182509019648:12345-192.168.201.14@tcp:59:lhsmtool_posix.0 Request processed in 162us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360106.567553:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:0.0:1787360106.640083:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.640244:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019776 00000100:00100000:3.0:1787360106.640259:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019776 00000100:00100000:3.0:1787360106.640328:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:3.0:1787360106.640344:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+9:14437:x1874182509019776:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360106.640372:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360106.640394:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce968 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.640471:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.640490:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.640506:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.640522:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.640529:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.640537:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643662:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643702:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643822:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643830:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360106.643835:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643864:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643888:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:2.0:1787360106.643893:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360106.643898:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643904:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643922:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643928:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643933:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643938:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360106.643941:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643946:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643953:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff983d0947c700) 00010000:00010000:2.0:1787360106.643955:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360106.643958:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.643972:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4bc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.644031:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4bb3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce968 expref: 10 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.644043:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:2.0:1787360106.644045:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360106.644049:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce968 expref: 10 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.644058:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b63c00, rc 0) 00000100:00100000:2.0:1787360106.644216:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+9:14437:x1874182509019776:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 3870us (4141us total) trans 0 rc 301/301 00000100:00100000:2.0:1787360106.644226:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:2.0:1787360106.651005:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360106.651157:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509019904 00000100:00100000:1.0:1787360106.651171:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509019904 00000100:00100000:1.0:1787360106.651351:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:1.0:1787360106.651378:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0e8b748a-0492-40f2-a25b-11c67731819d+9:14437:x1874182509019904:12345-192.168.201.14@tcp:700:lfs.0 00000100:00100000:1.0:1787360106.651482:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0e8b748a-0492-40f2-a25b-11c67731819d+9:14437:x1874182509019904:12345-192.168.201.14@tcp:700:lfs.0 Request processed in 109us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360106.651491:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:1.0:1787360106.665479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.666605:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509020160 00000100:00100000:3.0:1787360106.666627:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509020160 00000100:00100000:0.0:1787360106.669160:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00100000:0.0:1787360106.669233:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+9:14437:x1874182509020160:12345-192.168.201.14@tcp:36:lfs.0 00010000:00010000:0.0:1787360106.669288:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360106.669358:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4af6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce8e3 expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.669385:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:0.0:1787360106.669391:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360106.670042:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.670065:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 5 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.670074:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.670119:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 5 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.670138:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 5 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.670156:0:14466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d08635c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14466:1874182527885056:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360106.670324:0:14466:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d2033f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787360106.674069:0:14466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d08635c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14466:1874182527885056:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360106.674114:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360106.675796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360106.676157:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509020288 00000100:00100000:2.0:1787360106.676170:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509020288 00010000:00010000:2.0:1787360106.676246:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 6 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360106.676289:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:2.0:1787360106.676299:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6949df5b-9793-423b-8f61-49e185cfa20a+6:2362:x1874182509020288:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360106.676328:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360106.676337:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 6 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.676375:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 6 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.676410:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4b2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce945 expref: 6 pid: 14467 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.676431:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:2.0:1787360106.676437:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.676447:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.676464:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.676505:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360106.676563:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6949df5b-9793-423b-8f61-49e185cfa20a+5:2362:x1874182509020288:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 265us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360106.676572:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00010000:00010000:3.0:1787360106.676774:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.676783:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.676813:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.676834:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.676843:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.678535:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787360106.678553:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.678564:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.678571:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.678578:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360106.678582:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.678591:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.678609:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d03ae5a00) 00010000:00010000:3.0:1787360106.678612:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.678618:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.678624:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4bc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360106.678658:0:14466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c52599bb reply state 00000000e767fcbd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360106.678667:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360106.678826:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+10:14437:x1874182509020160:12345-192.168.201.14@tcp:36:lfs.0 Request processed in 9647us (13354us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787360106.678836:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 19 00000100:00080000:0.0:1787360106.679560:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787360106.682595:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.682614:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.682622:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.682628:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360106.682633:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.682642:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.682660:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff983d0947c600) 00010000:00010000:3.0:1787360106.682663:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.682668:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.682716:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4bcf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360106.755891:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360106.759472:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509020416 00000100:00100000:0.0:1787360106.759492:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509020416 00000100:00100000:0.0:1787360106.759623:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:0.0:1787360106.759639:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+9:14445:x1874182509020416:12345-192.168.201.14@tcp:101:lctl.0 00010000:00010000:0.0:1787360106.761638:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.761719:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce96f expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.761845:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef4bdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.761865:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.761881:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.761986:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787360106.761990:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360106.762047:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.762155:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce96f expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.762188:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41200/0x72f6de40e4ef4bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce96f expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.762224:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360106.762227:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360106.762232:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41200, rc 0) 00000100:00100000:0.0:1787360106.762345:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+10:14445:x1874182509020416:12345-192.168.201.14@tcp:101:lctl.0 Request processed in 2709us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.762355:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 20 00000100:00100000:1.0:1787360106.825267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360106.825869:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509020544 00000100:00100000:2.0:1787360106.825885:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509020544 00000100:00100000:2.0:1787360106.825968:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:2.0:1787360106.825981:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+5:14446:x1874182509020544:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:2.0:1787360106.826003:0:16338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360106.826029:0:16338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4be4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce976 expref: -99 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.826442:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4beb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.826470:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.826557:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787360106.827051:0:16338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787360106.827056:0:16338:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787360106.827400:0:16338:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.827438:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce976 expref: 7 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.828041:0:16338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9a00/0x72f6de40e4ef4beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce976 expref: 6 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.828054:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:2.0:1787360106.828057:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787360106.828061:0:16338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9a00, rc 0) 00000100:00100000:2.0:1787360106.828162:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+6:14446:x1874182509020544:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 2182us (2979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360106.828172:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 21 00000100:00100000:2.0:1787360106.834924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360106.835030:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509020672 00000100:00100000:0.0:1787360106.835042:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509020672 00000100:00100000:0.0:1787360106.835285:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:0.0:1787360106.835299:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+6:14446:x1874182509020672:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360106.835334:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.835359:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce97d expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835434:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835464:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835487:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835504:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835512:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835537:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.835996:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4c07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836007:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4c07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836015:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4c07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.836059:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787360106.836063:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360106.836305:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4c07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836330:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836337:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836345:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836352:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360106.836357:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836366:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836392:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360106.836396:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.836402:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836409:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836427:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836433:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836438:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836444:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360106.836447:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836462:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836530:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff983d09750e00) 00010000:00010000:0.0:1787360106.836533:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.836536:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836542:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836588:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce97d expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836603:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4c07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce97d expref: 7 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.836610:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750700) 00010000:00010000:0.0:1787360106.836613:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360106.836615:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41e00, rc 0) 00000100:00100000:0.0:1787360106.837061:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+7:14446:x1874182509020672:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1763us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.837269:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 22 00000100:00100000:0.0:1787360106.844868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.845403:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509020928 00000100:00100000:3.0:1787360106.845417:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509020928 00000100:00100000:3.0:1787360106.845634:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:3.0:1787360106.845648:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6949df5b-9793-423b-8f61-49e185cfa20a+7:14446:x1874182509020928:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360106.845674:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360106.845734:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce984 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.846441:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787360106.846671:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce984 expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.847043:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:3.0:1787360106.847046:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360106.847053:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce984 expref: 9 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.847068:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62a00, rc 0) 00000100:00100000:2.0:1787360106.847578:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6949df5b-9793-423b-8f61-49e185cfa20a+8:14446:x1874182509020928:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1929us (2718us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787360106.847605:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 23 00000100:00100000:1.0:1787360106.853433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.854068:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509021184 00000100:00100000:3.0:1787360106.854138:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509021184 00000100:00100000:2.0:1787360106.854445:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 24 00000100:00100000:2.0:1787360106.854477:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6949df5b-9793-423b-8f61-49e185cfa20a+8:14446:x1874182509021184:12345-192.168.201.14@tcp:36:lfs.0 00010000:00010000:2.0:1787360106.854542:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360106.854582:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4c07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce97d expref: 8 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.854603:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750700) 00010000:00010000:2.0:1787360106.854614:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360106.854639:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.854652:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.854663:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787360106.855016:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c0745c4 reply state 00000000c52c6796 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360106.855027:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787360106.855038:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787360106.855140:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6949df5b-9793-423b-8f61-49e185cfa20a+9:14446:x1874182509021184:12345-192.168.201.14@tcp:36:lfs.0 Request processed in 673us (1715us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787360106.855147:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 24 00010000:00010000:1.0:1787360106.859779:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.859801:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.859811:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.859817:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8200 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360106.859824:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.859832:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.859860:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d03ae5300) 00010000:00010000:1.0:1787360106.859864:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787360106.859869:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.859877:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8200/0x72f6de40e4ef4c1c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360106.862546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360106.863188:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509021440 00000100:00100000:3.0:1787360106.863368:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509021440 00000100:00100000:3.0:1787360106.863560:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:3.0:1787360106.863573:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6949df5b-9793-423b-8f61-49e185cfa20a+8:14446:x1874182509021440:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:3.0:1787360106.863927:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6949df5b-9793-423b-8f61-49e185cfa20a+9:14446:x1874182509021440:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 355us (1489us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787360106.863950:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:2.0:1787360106.869418:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360106.869565:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509021696 00000100:00100000:1.0:1787360106.869578:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509021696 00000100:00100000:1.0:1787360106.869644:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:1.0:1787360106.869656:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+9:14446:x1874182509021696:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:1.0:1787360106.869722:0:16338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360106.869890:0:16338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef4c23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce98b expref: -99 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.869991:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870007:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870019:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870034:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870040:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870047:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360106.870332:0:16338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787360106.870431:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870439:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870446:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870463:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165a400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360106.870468:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870879:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870895:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360106.870898:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360106.870903:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870910:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870923:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870929:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870936:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870941:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165ba00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360106.870944:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870949:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870956:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff983d03a4ff00) 00010000:00010000:1.0:1787360106.870958:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360106.870961:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.870976:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ba00/0x72f6de40e4ef4c31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.871024:0:16338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef4c23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce98b expref: 11 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.871036:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:1.0:1787360106.871038:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787360106.871042:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ac00/0x72f6de40e4ef4c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce98b expref: 11 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360106.871052:0:16338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165ac00, rc 0) 00000100:00100000:1.0:1787360106.871399:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6949df5b-9793-423b-8f61-49e185cfa20a+10:14446:x1874182509021696:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1742us (1990us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787360106.871408:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 25 00000100:00100000:1.0:1787360106.878021:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360106.878179:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509021824 00000100:00100000:0.0:1787360106.878257:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509021824 00000100:00100000:0.0:1787360106.878428:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:0.0:1787360106.878441:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+10:14446:x1874182509021824:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360106.878491:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.878519:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce992 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.878633:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.878650:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.878934:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.878991:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787360106.878996:0:14467:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360106.879018:0:14467:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.879046:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 12 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.879065:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 11 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.879141:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787360106.879145:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787360106.879148:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40e00, rc 0) 00000100:00100000:0.0:1787360106.879357:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6949df5b-9793-423b-8f61-49e185cfa20a+11:14446:x1874182509021824:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 917us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.879366:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 26 00000100:00100000:1.0:1787360106.885176:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360106.885388:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509021952 00000100:00100000:0.0:1787360106.885401:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509021952 00000100:00100000:0.0:1787360106.885561:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:0.0:1787360106.885575:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6949df5b-9793-423b-8f61-49e185cfa20a+11:14446:x1874182509021952:12345-192.168.201.14@tcp:37:lfs.0 00000100:00100000:0.0:1787360106.900397:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6949df5b-9793-423b-8f61-49e185cfa20a+11:14446:x1874182509021952:12345-192.168.201.14@tcp:37:lfs.0 Request processed in 14810us (15217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.900412:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:3.0:1787360106.907376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360106.908605:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509022208 00000100:00100000:2.0:1787360106.908639:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509022208 00000100:00100000:2.0:1787360106.908980:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787360106.908995:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f606450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6949df5b-9793-423b-8f61-49e185cfa20a+11:14446:x1874182509022208:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787360106.910177:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f606450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6949df5b-9793-423b-8f61-49e185cfa20a+12:14446:x1874182509022208:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 1179us (2865us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787360106.910201:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787360106.963778:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360106.963892:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509022336 00000100:00100000:0.0:1787360106.963905:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509022336 00000100:00100000:0.0:1787360106.963986:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:0.0:1787360106.963998:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+10:14452:x1874182509022336:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:0.0:1787360106.964027:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360106.964055:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce999 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964152:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964169:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964183:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964199:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964205:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964210:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964336:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4c62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964346:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4c62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964380:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4c62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360106.964421:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787360106.964425:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360106.964484:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4c62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964497:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964504:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964511:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964517:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360106.964522:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964530:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964545:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360106.964549:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.964554:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964561:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4c54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964587:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964593:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964598:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964603:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360106.964606:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964611:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964619:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff983d09750100) 00010000:00010000:0.0:1787360106.964621:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360106.964624:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964630:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4c5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964662:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce999 expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964731:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40600/0x72f6de40e4ef4c62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce999 expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.964752:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787360106.964754:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787360106.964757:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40600, rc 0) 00000100:00100000:0.0:1787360106.964834:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+11:14452:x1874182509022336:12345-192.168.201.14@tcp:101:bash.0 Request processed in 838us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.964842:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 27 00000100:00100000:1.0:1787360106.970472:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360106.970581:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509022592 00000100:00100000:2.0:1787360106.970594:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509022592 00000100:00100000:2.0:1787360106.970668:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 28 00000100:00100000:2.0:1787360106.970713:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+11:14452:x1874182509022592:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:2.0:1787360106.970736:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360106.970761:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4c69 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9a0 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.970911:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.970928:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 11 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.970938:0:14465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.970982:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 11 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360106.970998:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 11 pid: 14467 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360106.971030:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14465:1874182527885184:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360106.971151:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787360106.975129:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14465:1874182527885184:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360106.975163:0:14465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360106.975542:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00010000:00010000:2.0:1787360106.984556:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787360106.985574:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509022720 00000100:00100000:0.0:1787360106.985590:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509022720 00010000:00010000:0.0:1787360106.985647:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 12 pid: 14467 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360106.985826:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:0.0:1787360106.985839:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6949df5b-9793-423b-8f61-49e185cfa20a+12:2362:x1874182509022720:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360106.985859:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360106.985868:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 12 pid: 14467 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.985884:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 12 pid: 14467 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.985909:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce992 expref: 12 pid: 14467 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.985929:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750e00) 00010000:00010000:0.0:1787360106.985952:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.985979:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.985987:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360106.986039:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360106.986114:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6949df5b-9793-423b-8f61-49e185cfa20a+11:2362:x1874182509022720:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 277us (11175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360106.986122:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00010000:00010000:3.0:1787360106.986193:0:14465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.986202:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.986246:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.986255:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.986264:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987062:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987075:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987083:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360106.987097:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787360106.987127:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987134:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987150:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987156:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8400 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360106.987161:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987169:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987181:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750e00) 00010000:00010000:3.0:1787360106.987184:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360106.987188:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987194:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8400/0x72f6de40e4ef4c70 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787360106.987210:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e452a6ae reply state 000000008e1f76ae transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360106.987220:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787360106.987265:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4c69 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 14 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987281:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 13 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360106.987290:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:3.0:1787360106.987298:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787360106.987302:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62400, rc 0) 00000100:00100000:3.0:1787360106.987370:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+14:14452:x1874182509022592:12345-192.168.201.14@tcp:101:bash.0 Request processed in 16691us (16907us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787360106.987380:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 28 00010000:00010000:3.0:1787360107.000495:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.000516:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.000524:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.000530:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360107.000535:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.000544:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.000562:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff983d0947c600) 00010000:00010000:3.0:1787360107.000565:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360107.000569:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.000575:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4c77 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360107.007096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360107.007257:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509022848 00000100:00100000:1.0:1787360107.007273:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509022848 00000100:00100000:1.0:1787360107.007357:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:1.0:1787360107.007371:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+13:14452:x1874182509022848:12345-192.168.201.14@tcp:101:bash.0 00010000:00010000:1.0:1787360107.007408:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360107.007437:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c8c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9a7 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007552:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007569:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007582:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360107.007632:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787360107.007638:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787360107.007662:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007674:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007757:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a400/0x72f6de40e4ef4c8c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007778:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 14 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.007789:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:1.0:1787360107.007791:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360107.007795:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165a600, rc 0) 00000100:00100000:1.0:1787360107.007877:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+14:14452:x1874182509022848:12345-192.168.201.14@tcp:101:bash.0 Request processed in 509us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.007887:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 29 00000100:00100000:1.0:1787360107.013209:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.021605:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509023104 00000100:00100000:0.0:1787360107.021633:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509023104 00000100:00100000:2.0:1787360107.028514:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:2.0:1787360107.028547:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+14:14452:x1874182509023104:12345-192.168.201.14@tcp:35:bash.0 00000100:00100000:2.0:1787360107.029559:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+15:14452:x1874182509023104:12345-192.168.201.14@tcp:35:bash.0 Request processed in 1020us (16359us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787360107.029575:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:1.0:1787360107.158974:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.159087:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509023360 00000100:00100000:0.0:1787360107.159100:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509023360 00000100:00100000:0.0:1787360107.159171:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:0.0:1787360107.159182:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+15:14463:x1874182509023360:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:0.0:1787360107.159208:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360107.159231:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9ae expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360107.159350:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787360107.159488:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ae expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.159508:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff983d09750400) 00010000:00010000:0.0:1787360107.159512:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360107.159517:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ae expref: 17 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.159557:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f40e00, rc 0) 00000100:00100000:0.0:1787360107.159621:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+16:14463:x1874182509023360:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 441us (662us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787360107.159629:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 30 00000100:00100000:1.0:1787360107.162951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360107.163129:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509023616 00000100:00100000:3.0:1787360107.163156:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509023616 00000100:00100000:3.0:1787360107.163223:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:3.0:1787360107.163236:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e8b748a-0492-40f2-a25b-11c67731819d+16:14463:x1874182509023616:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:3.0:1787360107.164111:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e8b748a-0492-40f2-a25b-11c67731819d+17:14463:x1874182509023616:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 874us (1168us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787360107.164121:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:1.0:1787360107.235389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.235506:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509023872 00000100:00100000:0.0:1787360107.235520:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509023872 00000100:00100000:3.0:1787360107.235957:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:3.0:1787360107.235975:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+17:14466:x1874182509023872:12345-192.168.201.14@tcp:101:lfs.0 00010000:00010000:3.0:1787360107.236005:0:16338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360107.236032:0:16338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ca8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9b5 expref: -99 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.236595:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4caf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.236614:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4caf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.236629:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4caf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360107.236644:0:16338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787360107.237608:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ca8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9b5 expref: 20 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.237631:0:16338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4caf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9b5 expref: 19 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.237657:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:3.0:1787360107.237660:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787360107.237663:0:16338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62600, rc 0) 00000100:00100000:3.0:1787360107.237812:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+19:14466:x1874182509023872:12345-192.168.201.14@tcp:101:lfs.0 Request processed in 1841us (2430us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787360107.237823:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 31 00000100:00100000:1.0:1787360107.244583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.245431:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509024000 00000100:00100000:0.0:1787360107.245454:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509024000 00000100:00100000:0.0:1787360107.245531:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:0.0:1787360107.245543:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+19:14466:x1874182509024000:12345-192.168.201.14@tcp:54:lfs.0 00010000:00010000:0.0:1787360107.245629:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245649:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245662:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245904:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245912:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245920:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245927:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360107.245946:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245954:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245969:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:0.0:1787360107.245973:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787360107.245977:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.245985:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4cbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360107.261258:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+19:14466:x1874182509024000:12345-192.168.201.14@tcp:54:lfs.0 Request processed in 15705us (16672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360107.261274:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 32 00000100:00100000:3.0:1787360107.266048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360107.269758:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360107.269858:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509024384 00000100:00100000:2.0:1787360107.269871:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509024384 00000100:00100000:2.0:1787360107.269934:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:2.0:1787360107.269945:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+19:14466:x1874182509024384:12345-192.168.201.14@tcp:35:lfs.0 00000100:00100000:2.0:1787360107.270206:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+20:14466:x1874182509024384:12345-192.168.201.14@tcp:35:lfs.0 Request processed in 262us (457us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787360107.270214:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:0.0:1787360107.280996:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509024128 00000100:00100000:0.0:1787360107.281016:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509024128 00000100:00100000:3.0:1787360107.285094:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:3.0:1787360107.285111:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e8b748a-0492-40f2-a25b-11c67731819d+20:2362:x1874182509024128:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787360107.285133:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360107.285162:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4caf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9b5 expref: 20 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.285184:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:3.0:1787360107.285190:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360107.285264:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e8b748a-0492-40f2-a25b-11c67731819d+19:2362:x1874182509024128:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 156us (19224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.285272:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000040:00080000:1.0:1787360107.496130:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787360107.555377:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360107.556164:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509024640 00000100:00100000:1.0:1787360107.556179:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509024640 00000100:00100000:1.0:1787360107.556309:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:1.0:1787360107.556322:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+19:14497:x1874182509024640:12345-192.168.201.14@tcp:101:cat.0 00010000:00010000:1.0:1787360107.556351:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360107.556376:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a800/0x72f6de40e4ef4cc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9bc expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.556515:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ae00/0x72f6de40e4ef4ccb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.556541:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ae00/0x72f6de40e4ef4ccb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.556554:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ae00/0x72f6de40e4ef4ccb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787360107.556574:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787360107.556759:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a800/0x72f6de40e4ef4cc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9bc expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.556779:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ae00/0x72f6de40e4ef4ccb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9bc expref: 21 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.556806:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:1.0:1787360107.556809:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787360107.556813:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165ae00, rc 0) 00000100:00100000:1.0:1787360107.556893:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+21:14497:x1874182509024640:12345-192.168.201.14@tcp:101:cat.0 Request processed in 573us (1581us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787360107.556901:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 33 00000100:00100000:0.0:1787360107.563501:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.563608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360107.564192:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025024 00000100:00100000:1.0:1787360107.564205:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025024 00000100:00100000:1.0:1787360107.564295:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:1.0:1787360107.564319:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+21:2365:x1874182509025024:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360107.564341:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360107.564377:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165ae00/0x72f6de40e4ef4ccb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9bc expref: 21 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.564404:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:1.0:1787360107.564412:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360107.564507:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+20:2365:x1874182509025024:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 191us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.564516:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:2.0:1787360107.567904:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509024896 00000100:00100000:2.0:1787360107.567924:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509024896 00000100:00100000:2.0:1787360107.568315:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:2.0:1787360107.568331:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+20:14497:x1874182509024896:12345-192.168.201.14@tcp:35:cat.0 00000100:00100000:2.0:1787360107.568944:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+21:14497:x1874182509024896:12345-192.168.201.14@tcp:35:cat.0 Request processed in 614us (5453us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787360107.568953:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 8 00000100:00100000:0.0:1787360107.596777:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.596824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.596852:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.596884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360107.596958:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025152 00000100:00100000:2.0:1787360107.596971:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025152 00000100:00100000:1.0:1787360107.597033:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025408 00000100:00100000:1.0:1787360107.597040:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025408 00000100:00100000:2.0:1787360107.597043:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 121 00000100:00100000:2.0:1787360107.597057:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:2365:x1874182509025152:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360107.597083:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025664 00000100:00100000:1.0:1787360107.597087:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025664 00000100:00100000:1.0:1787360107.597104:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025280 00000100:00100000:1.0:1787360107.597107:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025280 00000100:00100000:1.0:1787360107.597124:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:1.0:1787360107.597148:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d08634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+5:2365:x1874182509025408:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:3.0:1787360107.597195:0:15146:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787360107.597236:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9368da36-bbfd-4d9d-8a37-d6c06d166ff1+13:2365:x1874182509025152:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 182us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360107.597245:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 121 00000100:00100000:3.0:1787360107.597294:0:15146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787360107.599604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360107.599605:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d08634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+5:2365:x1874182509025408:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 2443us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.599624:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:0.0:1787360107.599800:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:0.0:1787360107.599817:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6949df5b-9793-423b-8f61-49e185cfa20a+5:2365:x1874182509025664:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:0.0:1787360107.599886:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6949df5b-9793-423b-8f61-49e185cfa20a+5:2365:x1874182509025664:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 76us (3033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360107.599908:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:0.0:1787360107.599923:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:0.0:1787360107.599930:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+5:2365:x1874182509025280:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360107.599955:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025536 00000100:00100000:0.0:1787360107.599961:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+5:2365:x1874182509025280:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 30us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.599968:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025536 00000100:00100000:0.0:1787360107.599968:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00080000:0.0:1787360107.599992:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787360107.599997:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360107.600022:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:1.0:1787360107.600030:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6949df5b-9793-423b-8f61-49e185cfa20a+5:2365:x1874182509025536:12345-192.168.201.14@tcp:400:kworker.0 00000100:00100000:1.0:1787360107.600059:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40995880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6949df5b-9793-423b-8f61-49e185cfa20a+5:2365:x1874182509025536:12345-192.168.201.14@tcp:400:kworker.0 Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.600066:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:0.0:1787360107.642835:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360107.643011:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509025920 00000100:00100000:3.0:1787360107.643024:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509025920 00000100:00100000:3.0:1787360107.643103:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:3.0:1787360107.643116:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+21:14503:x1874182509025920:12345-192.168.201.14@tcp:101:dd.0 00010000:00010000:3.0:1787360107.643170:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360107.643196:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4cd9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9c3 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643358:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643377:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 22 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643386:0:14465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643395:0:14465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643449:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643464:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 22 pid: 14466 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360107.643480:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14465:1874182527885312:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360107.643596:0:14465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 22 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.643606:0:14465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 22 pid: 14465 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360107.643627:0:14465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14465:1874182527885440:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787360107.643652:0:14465:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12e449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787360107.646138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360107.646184:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360107.646289:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509026048 00000100:00100000:2.0:1787360107.646300:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509026048 00000100:00100000:1.0:1787360107.646320:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509026176 00000100:00100000:1.0:1787360107.646324:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509026176 00000100:00100000:3.0:1787360107.646404:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14465:1874182527885312:192.168.201.14@tcp:104: 00000100:00100000:3.0:1787360107.646416:0:14465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14465:1874182527885440:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360107.646457:0:14465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.646512:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 24 pid: 14466 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360107.646555:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:2.0:1787360107.646567:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d415f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e8b748a-0492-40f2-a25b-11c67731819d+24:2363:x1874182509026048:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360107.646587:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360107.646595:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 24 pid: 14466 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.646609:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 24 pid: 14466 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.646633:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d0165a600/0x72f6de40e4ef4c93 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a7 expref: 24 pid: 14466 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.646723:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:2.0:1787360107.646729:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.646737:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.646743:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360107.646797:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d415f6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e8b748a-0492-40f2-a25b-11c67731819d+23:2363:x1874182509026048:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 231us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360107.646805:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00010000:00010000:1.0:1787360107.648261:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 23 pid: 14465 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360107.648389:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:1.0:1787360107.648404:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d40996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+22:2363:x1874182509026176:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787360107.648424:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787360107.648431:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 22 pid: 14465 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.648454:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 22 pid: 14465 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.648478:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62400/0x72f6de40e4ef4c7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9a0 expref: 22 pid: 14465 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.648507:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:1.0:1787360107.648512:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.648522:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.648542:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.648578:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787360107.648628:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40996680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+21:2363:x1874182509026176:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 229us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360107.648637:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00010000:00010000:0.0:1787360107.648719:0:14465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.648729:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360107.648749:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787360107.648919:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4cd9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9c3 expref: 22 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.648936:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62a00/0x72f6de40e4ef4ce0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9c3 expref: 21 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360107.648943:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:0.0:1787360107.648945:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787360107.648948:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62a00, rc 0) 00000100:00100000:0.0:1787360107.648983:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d40994000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+21:14503:x1874182509025920:12345-192.168.201.14@tcp:101:dd.0 Request processed in 5870us (6165us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787360107.648990:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 34 00000100:00100000:0.0:1787360107.657951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360107.658027:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509026432 00000100:00100000:3.0:1787360107.658040:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509026432 00000100:00100000:3.0:1787360107.658109:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 35 00000100:00100000:3.0:1787360107.658121:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+21:14503:x1874182509026432:12345-192.168.201.14@tcp:36:dd.0 00010000:00010000:3.0:1787360107.658431:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.658462:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.658475:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787360107.658537:0:16338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787360107.658577:0:16338:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cefa778 reply state 00000000cbdc545c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360107.658586:0:16338:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360107.658712:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+24:14503:x1874182509026432:12345-192.168.201.14@tcp:36:dd.0 Request processed in 592us (769us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787360107.658736:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 35 00000020:00080000:3.0:1787360107.658743:0:16338:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787360107.661170:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.661190:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.661198:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.661205:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360107.661210:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.661218:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.661257:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:1.0:1787360107.661260:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360107.661266:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360107.661272:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4cee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360107.661623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360107.661712:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509026560 00000100:00100000:2.0:1787360107.661724:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509026560 00000100:00100000:2.0:1787360107.661785:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:2.0:1787360107.661797:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+23:14503:x1874182509026560:12345-192.168.201.14@tcp:101:dd.0 00010000:00010000:2.0:1787360107.661823:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360107.661845:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8a00/0x72f6de40e4ef4cf5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9ca expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.661909:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8a00/0x72f6de40e4ef4cf5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ca expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.661924:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8a00/0x72f6de40e4ef4cf5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ca expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.661945:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:2.0:1787360107.661957:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360107.661960:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f8a00, rc 0) 00000100:00100000:2.0:1787360107.662023:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+24:14503:x1874182509026560:12345-192.168.201.14@tcp:101:dd.0 Request processed in 227us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360107.662031:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 36 00000100:00100000:2.0:1787360107.674516:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360107.674610:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509026816 00000100:00100000:3.0:1787360107.674622:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509026816 00000100:00100000:3.0:1787360107.674735:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:3.0:1787360107.674747:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e8b748a-0492-40f2-a25b-11c67731819d+24:14503:x1874182509026816:12345-192.168.201.14@tcp:103:dd.0 00010000:00010000:3.0:1787360107.674767:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787360107.674798:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8a00/0x72f6de40e4ef4cf5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ca expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.674819:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:3.0:1787360107.674825:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787360107.674889:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e8b748a-0492-40f2-a25b-11c67731819d+23:14503:x1874182509026816:12345-192.168.201.14@tcp:103:dd.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.674896:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:1.0:1787360107.677737:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360107.677821:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509026944 00000100:00100000:3.0:1787360107.677834:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509026944 00000100:00100000:3.0:1787360107.677882:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:3.0:1787360107.677890:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+23:14503:x1874182509026944:12345-192.168.201.14@tcp:58:dd.0 00010000:00010000:3.0:1787360107.677982:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.677998:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360107.678007:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360107.679593:0:16338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787360107.680006:0:16338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787360107.680084:0:16338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787360107.680266:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+23:14503:x1874182509026944:12345-192.168.201.14@tcp:58:dd.0 Request processed in 2369us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360107.680279:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 37 00000100:00100000:1.0:1787360107.700252:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360107.700576:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509027072 00000100:00100000:2.0:1787360107.700590:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509027072 00000100:00100000:2.0:1787360107.700666:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 38 00000100:00100000:2.0:1787360107.700872:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+23:14503:x1874182509027072:12345-192.168.201.14@tcp:101:dd.0 00010000:00010000:2.0:1787360107.700901:0:14467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360107.700933:0:14467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9d1 expref: -99 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.701007:0:14467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.701021:0:14467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.701046:0:14467:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.701061:0:14467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.701075:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:2.0:1787360107.701078:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787360107.701096:0:14467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 24 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360107.701106:0:14467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9600, rc 0) 00000100:00100000:2.0:1787360107.701181:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+24:14503:x1874182509027072:12345-192.168.201.14@tcp:101:dd.0 Request processed in 504us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360107.701189:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 38 00010000:00010000:1.0:1787360108.008997:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787360108.518958:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787360108.518968:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360108.519010:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787360108.519019:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787360108.519384:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14498:1874182527885568:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787360108.519525:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d12f2a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787360108.528203:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1dc0f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14498:1874182527885568:192.168.201.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787360108.528829:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.529151:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509027200 00000100:00100000:3.0:1787360108.529161:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509027200 00000100:00100000:3.0:1787360108.529237:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:3.0:1787360108.529249:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027200:12345-192.168.201.14@tcp:900:lhsmtool_posix.0 00000100:00080000:0.0:1787360108.529509:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360108.531172:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027200:12345-192.168.201.14@tcp:900:lhsmtool_posix.0 Request processed in 1907us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.531187:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:2.0:1787360108.538002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.549795:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509027328 00000100:00100000:3.0:1787360108.549815:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509027328 00000100:00100000:3.0:1787360108.549905:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:3.0:1787360108.549919:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027328:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787360108.549961:0:16338:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787360108.550105:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027328:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 188us (12113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.550114:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 39 00000100:00100000:0.0:1787360108.560252:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.560511:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509027456 00000100:00100000:3.0:1787360108.560525:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509027456 00000100:00100000:3.0:1787360108.560600:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:3.0:1787360108.560613:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027456:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.560762:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560785:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560797:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560849:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560858:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560864:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560888:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560897:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560904:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360108.560945:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787360108.560949:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787360108.560963:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560974:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560987:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.560994:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561000:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360108.561004:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561011:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561025:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d0947ce00) 00010000:00010000:3.0:1787360108.561028:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.561034:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561040:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63a00/0x72f6de40e4ef4d0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561056:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561061:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561066:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561070:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360108.561080:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561086:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561094:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff983d0947c600) 00010000:00010000:3.0:1787360108.561096:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.561099:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561105:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561121:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561127:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561132:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561137:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62600 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360108.561140:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561146:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561154:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:3.0:1787360108.561156:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787360108.561165:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.561170:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.561264:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027456:12345-192.168.201.14@tcp:34:lhsmtool_posix.0 Request processed in 652us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.561273:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 40 00000100:00100000:1.0:1787360108.582573:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.582717:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509027712 00000100:00100000:3.0:1787360108.582730:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509027712 00000100:00100000:3.0:1787360108.582795:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:3.0:1787360108.582807:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+24:14504:x1874182509027712:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.582831:0:16338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360108.582855:0:16338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9d8 expref: -99 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.582963:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.582982:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.582995:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787360108.583009:0:16338:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787360108.583120:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583128:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583147:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583154:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360108.583159:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583167:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583181:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:3.0:1787360108.583185:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360108.583189:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583196:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583235:0:16338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d8 expref: 26 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583244:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff983d0947ce00) 00010000:00010000:3.0:1787360108.583246:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787360108.583250:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d8 expref: 26 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.583258:0:16338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d25b62600, rc 0) 00000100:00100000:3.0:1787360108.583455:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+25:14504:x1874182509027712:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 648us (890us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787360108.583473:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 41 00000100:00100000:1.0:1787360108.601748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.601874:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509027840 00000100:00100000:2.0:1787360108.601887:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509027840 00000100:00100000:2.0:1787360108.601967:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:2.0:1787360108.601979:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+25:14504:x1874182509027840:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787360108.602022:0:14467:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787360108.602137:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+25:14504:x1874182509027840:12345-192.168.201.14@tcp:53:lhsmtool_posix.0 Request processed in 161us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.602146:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 42 00000100:00100000:1.0:1787360108.609039:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.609193:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509028096 00000100:00100000:3.0:1787360108.609206:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509028096 00000100:00100000:3.0:1787360108.609279:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:3.0:1787360108.609301:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+25:14504:x1874182509028096:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.609324:0:16338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787360108.609349:0:16338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d34 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9df expref: -99 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787360108.610231:0:16338:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1787360108.610240:0:16338:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787360108.610288:0:16338:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1787360108.612034:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4d3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.612063:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.612077:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.612162:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62600/0x72f6de40e4ef4d34 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9df expref: 28 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.612187:0:16338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4d3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9df expref: 27 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.612212:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d03ae5f00) 00010000:00010000:2.0:1787360108.612215:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787360108.612220:0:16338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f9e00, rc 0) 00000100:00100000:2.0:1787360108.612305:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+27:14504:x1874182509028096:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 3005us (3273us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787360108.612328:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 43 00000100:00100000:1.0:1787360108.623014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.623140:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509028352 00000100:00100000:2.0:1787360108.623156:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509028352 00000100:00100000:2.0:1787360108.623229:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:2.0:1787360108.623243:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+27:14504:x1874182509028352:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.623341:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360108.623378:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4d3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9df expref: 27 pid: 16338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623405:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d03ae5f00) 00010000:00010000:2.0:1787360108.623427:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787360108.623458:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623475:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623487:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623500:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623528:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623535:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623616:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623624:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623632:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623639:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8000 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360108.623644:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623652:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623661:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff983d09750e00) 00010000:00010000:2.0:1787360108.623665:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360108.623669:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623734:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f8000/0x72f6de40e4ef4d49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623744:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623756:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623762:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623767:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:2.0:1787360108.623770:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623776:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623784:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x94120582 (ffff983d03ae5300) 00010000:00010000:2.0:1787360108.623787:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787360108.623789:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.623796:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9c00/0x72f6de40e4ef4d50 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x94120582 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.624428:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+26:14504:x1874182509028352:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 1173us (1411us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787360108.624438:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 44 00000100:00100000:1.0:1787360108.641893:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360108.642008:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509028480 00000100:00100000:0.0:1787360108.642021:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509028480 00000100:00100000:0.0:1787360108.642098:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:0.0:1787360108.642112:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1dc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+26:14504:x1874182509028480:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360108.642141:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360108.642176:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d57 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9e6 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.642218:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4d5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.642236:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.642249:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.642391:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9e6 expref: 28 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.642414:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41400/0x72f6de40e4ef4d5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9e6 expref: 27 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.642445:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:0.0:1787360108.642448:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360108.642452:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41400, rc 0) 00000100:00100000:0.0:1787360108.642540:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1dc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+27:14504:x1874182509028480:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 431us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.642548:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 45 00000100:00100000:1.0:1787360108.648585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.648734:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509028736 00000100:00100000:3.0:1787360108.648749:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509028736 00000100:00100000:3.0:1787360108.648888:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 46 00000100:00100000:3.0:1787360108.648902:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+27:14504:x1874182509028736:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787360108.649029:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.649062:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.649076:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787360108.649555:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787360108.649566:0:14465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 482977888487ns, next at 483977885717ns, rc = 0 00000004:00010000:3.0:1787360108.649660:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c5f15b3 reply state 00000000e2655c1a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.649713:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787360108.649821:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+29:14504:x1874182509028736:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 921us (1248us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787360108.649830:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 46 00010000:00010000:3.0:1787360108.662870:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.662891:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.662898:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.662904:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:3.0:1787360108.662910:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.662917:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.662936:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:3.0:1787360108.662940:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787360108.662946:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.662952:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b63c00/0x72f6de40e4ef4d65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360108.667673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360108.667874:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509028864 00000100:00100000:0.0:1787360108.667887:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509028864 00000100:00100000:0.0:1787360108.667954:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:0.0:1787360108.667966:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+28:14504:x1874182509028864:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360108.667996:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360108.668017:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9ed expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.668083:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 29 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.668100:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 29 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.668121:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:0.0:1787360108.668124:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360108.668129:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41800, rc 0) 00000100:00100000:0.0:1787360108.668207:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+29:14504:x1874182509028864:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 243us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.668229:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 47 00000100:00100000:1.0:1787360108.672806:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.672927:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509028992 00000100:00100000:2.0:1787360108.672941:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509028992 00000100:00100000:2.0:1787360108.673008:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:2.0:1787360108.673021:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+5:2364:x1874182509028992:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787360108.673494:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+6:2364:x1874182509028992:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 475us (700us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787360108.673519:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 12 00000100:00100000:3.0:1787360108.681938:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.682061:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509029248 00000100:00100000:2.0:1787360108.682077:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509029248 00000100:00100000:2.0:1787360108.682153:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:2.0:1787360108.682166:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e8b748a-0492-40f2-a25b-11c67731819d+29:14504:x1874182509029248:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787360108.682748:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e8b748a-0492-40f2-a25b-11c67731819d+30:14504:x1874182509029248:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 580us (818us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787360108.682758:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 9 00000100:00100000:1.0:1787360108.687894:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.688035:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509029504 00000100:00100000:2.0:1787360108.688048:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509029504 00000100:00100000:2.0:1787360108.688156:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:2.0:1787360108.688168:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+30:14504:x1874182509029504:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787360108.688304:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e8b748a-0492-40f2-a25b-11c67731819d+30:14504:x1874182509029504:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.688313:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 48 00000100:00100000:1.0:1787360108.695640:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360108.695772:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509029632 00000100:00100000:0.0:1787360108.695783:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509029632 00000100:00100000:0.0:1787360108.695854:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:0.0:1787360108.695867:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+30:14504:x1874182509029632:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787360108.695888:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787360108.695911:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d73 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9f4 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.695983:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4d7a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.695997:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4d7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.696011:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4d7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787360108.696046:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787360108.696062:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4d7a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.696086:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d73 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9f4 expref: 32 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.696105:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4d7a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9f4 expref: 31 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.696115:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:0.0:1787360108.696131:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787360108.696135:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983c02f41c00, rc 0) 00000100:00100000:0.0:1787360108.696203:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+31:14504:x1874182509029632:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 338us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.696211:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 49 00000100:00100000:1.0:1787360108.699112:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.699206:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509029760 00000100:00100000:3.0:1787360108.699235:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509029760 00000100:00100000:1.0:1787360108.699370:0:16686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:1.0:1787360108.699383:0:16686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e8b748a-0492-40f2-a25b-11c67731819d+6:2363:x1874182509029760:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787360108.699407:0:16686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787360108.699442:0:16686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1ce9fb expref: -99 pid: 16686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360108.699473:0:16686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a88f36c, blocks: 0x1 00010000:00010000:1.0:1787360108.699497:0:16686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:1.0:1787360108.699503:0:16686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360108.699521:0:16686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 7 pid: 16686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.699553:0:16686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 7 pid: 16686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.699568:0:16686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d0165ae00, rc 0) 00000100:00100000:1.0:1787360108.699641:0:16686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2363:x1874182509029760:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 262us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360108.699647:0:16686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:2.0:1787360108.721625:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.721722:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030016 00000100:00100000:3.0:1787360108.721737:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030016 00000100:00100000:3.0:1787360108.721813:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:3.0:1787360108.721827:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d1e18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+31:14504:x1874182509030016:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787360108.721948:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d1e18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+31:14504:x1874182509030016:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.721956:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 50 00000100:00100000:0.0:1787360108.727964:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.728060:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030144 00000100:00100000:3.0:1787360108.728071:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030144 00000100:00100000:3.0:1787360108.728145:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 51 00000100:00100000:3.0:1787360108.728157:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+31:14504:x1874182509030144:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787360108.792124:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f8ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e8b748a-0492-40f2-a25b-11c67731819d+31:14504:x1874182509030144:12345-192.168.201.14@tcp:44:lhsmtool_posix.0 Request processed in 63956us (64156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.792139:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 51 00000001:00080000:1.0:1787360108.792301:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1787360108.792325:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1787360108.792330:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1787360108.792340:0:5884:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:1.0:1787360108.792349:0:5884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787360108.792743:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787360108.792763:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527885696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787360108.792833:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360108.793171:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527885696 00000100:00100000:2.0:1787360108.793183:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527885696 00000100:00100000:2.0:1787360108.793290:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787360108.793302:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527885696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787360108.793482:0:15148:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787360108.793495:0:15148:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787360108.793497:0:15148:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787360108.793499:0:15148:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787360108 -> 1787360108 00002000:00010000:2.0:1787360108.793502:0:15148:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787360108.793561:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1874182527885696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 261us (727us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787360108.793570:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787360108.793669:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff983d1e18f480/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787360108.793707:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527885696:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787360108.793955:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360108.797453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360108.797515:0:16686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030272 00000100:00100000:1.0:1787360108.797528:0:16686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030272 00000100:00100000:1.0:1787360108.797611:0:16686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:1.0:1787360108.797633:0:16686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2362:x1874182509030272:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787360108.797791:0:16686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2362:x1874182509030272:12345-192.168.201.14@tcp:16:lhsmtool_posix.0 Request processed in 161us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787360108.797800:0:16686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:3.0:1787360108.802150:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360108.802232:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030528 00000100:00100000:0.0:1787360108.802246:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030528 00000100:00100000:0.0:1787360108.802395:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 52 00000100:00100000:0.0:1787360108.802409:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+14:14504:x1874182509030528:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787360108.802510:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360108.802556:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41c00/0x72f6de40e4ef4d7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9f4 expref: 14 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.802576:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:0.0:1787360108.802582:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787360108.802630:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.802648:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.802661:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787360108.803010:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006b192b0 reply state 0000000048b892af transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.803021:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787360108.803164:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e8b748a-0492-40f2-a25b-11c67731819d+15:14504:x1874182509030528:12345-192.168.201.14@tcp:36:lhsmtool_posix.0 Request processed in 758us (1027us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787360108.803173:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 52 00010000:00010000:1.0:1787360108.804967:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.804987:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.804995:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.805001:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f40e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:1.0:1787360108.805006:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.805014:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.805034:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:1.0:1787360108.805053:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787360108.805059:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360108.805066:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f40e00/0x72f6de40e4ef4d88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360108.807370:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.808131:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030656 00000100:00100000:2.0:1787360108.808147:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030656 00000100:00100000:2.0:1787360108.808274:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787360108.808296:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+7:14504:x1874182509030656:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.808319:0:15148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787360108.808342:0:15148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe7b35416fb1cea02 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.808384:0:15148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.808395:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360108.808400:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360108.808406:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 8 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.808459:0:15148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.808477:0:15148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.808526:0:15148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15148:1874182527885824:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360108.808655:0:15148:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360108.813380:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.814117:0:15148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15148:1874182527885824:192.168.201.14@tcp:104: 00010000:00010000:3.0:1787360108.814161:0:15148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 8 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360108.814185:0:15148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff983d411f8000, rc 0) 00000100:00100000:3.0:1787360108.814251:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e8b748a-0492-40f2-a25b-11c67731819d+8:14504:x1874182509030656:12345-192.168.201.14@tcp:101:lhsmtool_posix.0 Request processed in 5957us (6891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360108.814262:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 16 00000100:00100000:2.0:1787360108.816634:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030784 00000100:00100000:2.0:1787360108.816656:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030784 00010000:00010000:2.0:1787360108.816753:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.816803:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:2.0:1787360108.816817:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+8:2362:x1874182509030784:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360108.816838:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360108.816867:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.816884:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.816912:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000385776ad/0x72f6de40e4ef4d81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9fb expref: 8 pid: 16686 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.816932:0:14452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360108.816937:0:14452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360108.816946:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 7 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.816982:0:14452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 7 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.817032:0:14452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 7 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.817051:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14452:1874182527885952:192.168.201.14@tcp:105: 00000100:00100000:2.0:1787360108.817153:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787360108.826110:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14452:1874182527885952:192.168.201.14@tcp:105: 00010000:00010000:2.0:1787360108.826151:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360108.826230:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+7:2362:x1874182509030784:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 9414us (12862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.826246:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 13 00000100:00100000:3.0:1787360108.826822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360108.827398:0:16686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509030912 00000100:00100000:1.0:1787360108.827412:0:16686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509030912 00000100:00100000:1.0:1787360108.827498:0:16686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:1.0:1787360108.827509:0:16686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2363:x1874182509030912:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787360108.827986:0:16686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787360108.827991:0:16686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787360107 00002000:00010000:1.0:1787360108.827994:0:16686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787360106 00002000:00010000:1.0:1787360108.827996:0:16686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787360108 -> 1787360107 00002000:00010000:1.0:1787360108.827999:0:16686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787360108.828068:0:16686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e8b748a-0492-40f2-a25b-11c67731819d+8:2363:x1874182509030912:12345-192.168.201.14@tcp:2:lhsmtool_posix.0 Request processed in 559us (1248us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787360108.828077:0:16686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 17 00000100:00100000:1.0:1787360108.834886:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360108.841342:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509031040 00000100:00100000:0.0:1787360108.841361:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509031040 00000100:00100000:2.0:1787360108.841806:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:2.0:1787360108.841822:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+8:2365:x1874182509031040:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787360108.841877:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.841914:0:15149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 8 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.841924:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360108.841929:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787360108.841948:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.841996:0:15149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 8 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.842012:0:15149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 8 pid: 15148 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.842028:0:15149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15149:1874182527886080:192.168.201.14@tcp:104: 00000100:00100000:2.0:1787360108.842125:0:15149:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d087a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787360108.860271:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.860402:0:15149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15149:1874182527886080:192.168.201.14@tcp:104: 00010000:00010000:2.0:1787360108.860535:0:15149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.860726:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509031168 00000100:00100000:0.0:1787360108.860736:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509031168 00010000:00010000:0.0:1787360108.860785:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 9 pid: 15148 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.860828:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 14 00000100:00100000:0.0:1787360108.860839:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e8b748a-0492-40f2-a25b-11c67731819d+9:2362:x1874182509031168:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787360108.860860:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787360108.860969:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 9 pid: 15148 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.860985:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 9 pid: 15148 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.861016:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff4ed16e/0x72f6de40e4ef4d8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1cea02 expref: 9 pid: 15148 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.861036:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360108.861041:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787360108.861047:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.861079:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.861112:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787360108.861187:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e8b748a-0492-40f2-a25b-11c67731819d+8:2362:x1874182509031168:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 348us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.861195:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 14 00010000:00010000:2.0:1787360108.861341:0:15149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861351:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861381:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861390:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861410:0:15149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861439:0:15149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360108.861445:0:15149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861456:0:15149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861471:0:15149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.861477:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4d96 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.861534:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e8b748a-0492-40f2-a25b-11c67731819d+7:2365:x1874182509031040:12345-192.168.201.14@tcp:1:lhsmtool_posix.0 Request processed in 19716us (26658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.861556:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 18 00000100:00100000:1.0:1787360108.865278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360108.868839:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509031424 00000100:00100000:0.0:1787360108.868865:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509031424 00000100:00100000:0.0:1787360108.868974:0:16338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 53 00000100:00100000:0.0:1787360108.868988:0:16338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+14:14504:x1874182509031424:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787360108.869102:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869127:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869141:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869485:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869499:0:16338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869508:0:16338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869561:0:16338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.869577:0:16338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 15 pid: 14466 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.869593:0:16338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16338:1874182527886208:192.168.201.14@tcp:104: 00000100:00100000:0.0:1787360108.869739:0:16338:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dab180 going to sleep for 11 seconds 00000100:00100000:3.0:1787360108.874279:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360108.874362:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509031552 00000100:00100000:2.0:1787360108.874374:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509031552 00010000:00010000:2.0:1787360108.874452:0:14452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 16 pid: 14466 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360108.874513:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 15 00000100:00100000:2.0:1787360108.874557:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+16:2363:x1874182509031552:12345-192.168.201.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787360108.874578:0:14452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787360108.874586:0:14452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 16 pid: 14466 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.874603:0:14452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 16 pid: 14466 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.874640:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:2.0:1787360108.874646:0:14452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.874657:0:14452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.874667:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.874736:0:14452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787360108.874799:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8b748a-0492-40f2-a25b-11c67731819d+16:2363:x1874182509031552:12345-192.168.201.14@tcp:103:ldlm_bl.0 Request processed in 256us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.874809:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 15 00010000:00010000:0.0:1787360108.875848:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41800/0x72f6de40e4ef4d6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9ed expref: 15 pid: 14466 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.875874:0:16338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16338:1874182527886208:192.168.201.14@tcp:104: 00010000:00010000:0.0:1787360108.875986:0:16338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.875998:0:16338:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.876004:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787360108.876247:0:16338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787360108.876918:0:16338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787360108.876988:0:16338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787360108.877109:0:16338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16338:1874182527886336:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787360108.877260:0:16338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360108.877311:0:16338:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d27dab540 going to sleep for 11 seconds 00000100:00100000:2.0:1787360108.879852:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527886336 00000100:00100000:2.0:1787360108.879869:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527886336 00000100:00100000:2.0:1787360108.879944:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787360108.879957:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16338:x1874182527886336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787360108.880095:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16338:x1874182527886336:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360108.880121:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787360108.880311:0:16338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d3f8cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16338:1874182527886336:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787360108.882127:0:16338:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787360108.882238:0:16338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d39cc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16338:1874182527886464:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787360108.882319:0:16338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360108.882354:0:16338:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787360108.882481:0:14470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527886464 00000100:00100000:3.0:1787360108.882496:0:14470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527886464 00000100:00100000:3.0:1787360108.882565:0:14470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787360108.882576:0:14470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16338:x1874182527886464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787360108.882798:0:14470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16338:x1874182527886464:12345-0@lo:1000:mdt00_003.0 Request processed in 223us (477us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787360108.882806:0:14470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787360108.883661:0:16338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d39cc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16338:1874182527886464:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787360108.883725:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883739:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883747:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883754:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360108.883758:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883766:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883784:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:0.0:1787360108.883787:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360108.883793:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883800:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4da4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883836:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883855:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883861:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883867:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b62e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360108.883870:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883876:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.883885:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:0.0:1787360108.885728:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787360108.885747:0:16338:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.885765:0:16338:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.885775:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.885872:0:16338:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9600/0x72f6de40e4ef4d03 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.14@tcp remote: 0xe7b35416fb1ce9d1 expref: 18 pid: 14467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.886012:0:16338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d39cc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16338:1874182527886592:192.168.201.14@tcp:105: 00000100:00100000:0.0:1787360108.886147:0:16338:0:(client.c:2715:ptlrpc_set_wait()) set ffff983d1df88540 going to sleep for 11 seconds 00000100:00100000:0.0:1787360108.897598:0:16338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d39cc1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16338:1874182527886592:192.168.201.14@tcp:105: 00010000:00010000:0.0:1787360108.897657:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897671:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d25b62e00/0x72f6de40e4ef4cfc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897771:0:16338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897791:0:16338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897807:0:16338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897820:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897827:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897835:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897841:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41a00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360108.897846:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897855:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897905:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:0.0:1787360108.897909:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787360108.897914:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897921:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41a00/0x72f6de40e4ef4dab lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897932:0:16338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897939:0:16338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897944:0:16338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897950:0:16338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41e00 already unused, calling callback (ffffffffc20e54f0) 00010000:00010000:0.0:1787360108.897953:0:16338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897959:0:16338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897967:0:16338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff983d0947ca00) 00010000:00010000:0.0:1787360108.897970:0:16338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787360108.897973:0:16338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.897979:0:16338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983c02f41e00/0x72f6de40e4ef4d9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16338 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360108.898280:0:16338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e8b748a-0492-40f2-a25b-11c67731819d+18:14504:x1874182509031424:12345-192.168.201.14@tcp:57:lhsmtool_posix.0 Request processed in 29292us (33013us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787360108.898291:0:16338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 53 00000020:00080000:0.0:1787360108.898299:0:16338:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787360108.898623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000040:00080000:2.0:1787360108.898784:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787360108.898790:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787360108.898823:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787360108.898830:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787360108.901504:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509031680 00000100:00100000:0.0:1787360108.901525:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509031680 00000100:00100000:0.0:1787360108.901639:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:0.0:1787360108.901654:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3f605050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+18:14503:x1874182509031680:12345-192.168.201.14@tcp:49:dd.0 00000100:00100000:0.0:1787360108.901849:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3f605050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+18:14503:x1874182509031680:12345-192.168.201.14@tcp:49:dd.0 Request processed in 198us (3229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360108.901858:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 10 00000100:00100000:3.0:1787360108.902170:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360108.902289:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509031936 00000100:00100000:3.0:1787360108.902295:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509031936 00000100:00100000:3.0:1787360108.902318:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 11 00000100:00100000:3.0:1787360108.902325:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+18:14504:x1874182509031936:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787360108.903825:0:14469:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787360108.906983:0:14469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787360108.907075:0:14469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.907096:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.907108:0:14469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.907118:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.907124:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.907131:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360108.907156:0:14469:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787360108.907279:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e8b748a-0492-40f2-a25b-11c67731819d+20:14504:x1874182509031936:12345-192.168.201.14@tcp:35:lhsmtool_posix.0 Request processed in 4949us (5106us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787360108.907289:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 11 00000020:00080000:2.0:1787360108.907296:0:14469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787360108.907624:0:14454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787360108.907634:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.907642:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360108.907647:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.907657:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.907674:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff983d09750100) 00010000:00010000:0.0:1787360108.907715:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787360108.907721:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.907728:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff983d411f9e00/0x72f6de40e4ef4db2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360108.907755:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360108.907757:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360108.907759:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360109.030955:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787360109.167313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360109.167466:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032064 00000100:00100000:3.0:1787360109.167480:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032064 00000100:00100000:3.0:1787360109.167589:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:3.0:1787360109.167605:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e8b748a-0492-40f2-a25b-11c67731819d+7:2365:x1874182509032064:12345-192.168.201.14@tcp:4:dd.0 00000100:00080000:0.0:1787360109.167820:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787360109.167954:0:15152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a88f36b, atime: 0x6a88f36a, ctime: 0x6a88f36b, blocks: 0x1 00010000:00010000:3.0:1787360109.167967:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.167989:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:3.0:1787360109.167995:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360109.168003:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.168019:0:15152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360109.177986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360109.178070:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:3.0:1787360109.178219:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787360109.178232:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787360109.178581:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032320 00000100:00100000:1.0:1787360109.178619:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032320 00000100:00100000:1.0:1787360109.178742:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787360109.178749:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032192 00000100:00100000:1.0:1787360109.178752:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032192 00000100:00100000:3.0:1787360109.179490:0:16689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:3.0:1787360109.179504:0:16689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e8b748a-0492-40f2-a25b-11c67731819d+10:2364:x1874182509032320:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:3.0:1787360109.179552:0:16689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.179575:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360109.179581:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787360109.179589:0:16689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.179606:0:16689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360109.181991:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:0.0:1787360109.182130:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787360109.182141:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787360109.182267:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032448 00000100:00100000:0.0:1787360109.182286:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032448 00000100:00100000:0.0:1787360109.184236:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:0.0:1787360109.184261:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e8b748a-0492-40f2-a25b-11c67731819d+11:2364:x1874182509032192:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:0.0:1787360109.184321:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.184346:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360109.184351:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360109.184359:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.184376:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360109.211957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360109.212007:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360109.212034:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:1.0:1787360109.212053:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.14@tcp (source: 12345-192.168.201.14@tcp) 00000100:00100000:2.0:1787360109.212173:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1787360109.212189:0:15154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787360109.216061:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032576 00000100:00100000:1.0:1787360109.216077:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032576 00000100:00100000:1.0:1787360109.216162:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787360109.216176:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032704 00000100:00100000:1.0:1787360109.216179:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032704 00000100:00100000:1.0:1787360109.216194:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787360109.216199:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032960 00000100:00100000:1.0:1787360109.216202:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032960 00000100:00100000:1.0:1787360109.216214:0:15154:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787360109.216219:0:15154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182509032832 00000100:00100000:1.0:1787360109.216221:0:15154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182509032832 00000100:00100000:2.0:1787360109.216789:0:16691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:2.0:1787360109.216807:0:16691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e8b748a-0492-40f2-a25b-11c67731819d+17:2365:x1874182509032448:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:2.0:1787360109.216857:0:16691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.216882:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360109.216887:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360109.216895:0:16691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.216911:0:16691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787360109.370095:0:16690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787360109.370105:0:16690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787360107 -> 1787360108 00002000:00010000:1.0:1787360109.370109:0:16690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787360107 -> 1787360108 00002000:00010000:1.0:1787360109.370112:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 8199 00010000:00010000:1.0:1787360109.370131:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.370147:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.370157:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370260:0:16691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370281:0:16691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370289:0:16691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370296:0:16691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9200 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360109.370302:0:16691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370312:0:16691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370346:0:16691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370355:0:16691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a79e728f/0x72f6de40e4ef4dce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360109.370482:0:16691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e8b748a-0492-40f2-a25b-11c67731819d+25:2365:x1874182509032448:12345-192.168.201.14@tcp:4:dd.0 Request processed in 153672us (188495us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787360109.370492:0:16691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 3 00000100:00100000:2.0:1787360109.370529:0:16691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:2.0:1787360109.370543:0:16691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e8b748a-0492-40f2-a25b-11c67731819d+24:2365:x1874182509032576:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:2.0:1787360109.370584:0:16691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370596:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360109.370602:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360109.370609:0:16691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.370621:0:16691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374519:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374542:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374569:0:15152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374577:0:15152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63a00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:0.0:1787360109.374583:0:15152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374592:0:15152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374618:0:15152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374625:0:15152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a5ac995/0x72f6de40e4ef4db9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787360109.374796:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e8b748a-0492-40f2-a25b-11c67731819d+23:2365:x1874182509032064:12345-192.168.201.14@tcp:4:dd.0 Request processed in 207188us (207490us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787360109.374808:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 0 00000100:00100000:0.0:1787360109.374861:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 5 00000100:00100000:0.0:1787360109.374875:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e8b748a-0492-40f2-a25b-11c67731819d+22:2365:x1874182509032704:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:0.0:1787360109.374923:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374939:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360109.374951:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787360109.374959:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787360109.374974:0:15152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.378026:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360109.378042:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.378062:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.378098:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.378108:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091f96db4/0x72f6de40e4ef4dc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360109.378207:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e8b748a-0492-40f2-a25b-11c67731819d+23:2364:x1874182509032192:12345-192.168.201.14@tcp:4:dd.0 Request processed in 193948us (200130us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787360109.378219:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 2 00000100:00100000:1.0:1787360109.378270:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 6 00000100:00100000:1.0:1787360109.378286:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e8b748a-0492-40f2-a25b-11c67731819d+22:2365:x1874182509032960:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:1.0:1787360109.378335:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.378347:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360109.378352:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787360109.378358:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.378394:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360109.380041:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:1.0:1787360109.380095:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1787360109.380108:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:3.0:1787360109.387712:0:16689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.387735:0:16689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.387745:0:16689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.387753:0:16689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d25b63c00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360109.387768:0:16689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.387778:0:16689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.387804:0:16689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.387812:0:16689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000093efa61/0x72f6de40e4ef4dc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787360109.396906:0:16689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e8b748a-0492-40f2-a25b-11c67731819d+12:2364:x1874182509032320:12345-192.168.201.14@tcp:4:dd.0 Request processed in 217384us (218912us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787360109.396927:0:16689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 1 00000100:00100000:3.0:1787360109.396977:0:16689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.14@tcp, seq: 7 00000100:00100000:3.0:1787360109.396993:0:16689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e8b748a-0492-40f2-a25b-11c67731819d+11:2365:x1874182509032832:12345-192.168.201.14@tcp:4:dd.0 00010000:00010000:2.0:1787360109.404784:0:16689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.404854:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360109.404860:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787360109.404869:0:16689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.404887:0:16689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787360109.461457:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1787360109.461533:0:15152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1787360109.461538:0:15152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:1.0:1787360109.461556:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.461570:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.461581:0:15152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.461589:0:15152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983c02f41800 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:1.0:1787360109.461595:0:15152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.461605:0:15152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.461630:0:15152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787360109.461653:0:15152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b8dac3f/0x72f6de40e4ef4ddc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787360109.461805:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0e8b748a-0492-40f2-a25b-11c67731819d+17:2365:x1874182509032704:12345-192.168.201.14@tcp:4:dd.0 Request processed in 86928us (249790us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787360109.461816:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 5 00000001:00080000:1.0:1787360109.507728:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:1.0:1787360109.507750:0:6724:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1787360109.508123:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:2.0:1787360109.508142:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.508156:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.508165:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.508173:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d0165be00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360109.508178:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.508188:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.508212:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.508233:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003880af1f/0x72f6de40e4ef4de3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360109.508462:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0e8b748a-0492-40f2-a25b-11c67731819d+9:2365:x1874182509032960:12345-192.168.201.14@tcp:4:dd.0 Request processed in 130177us (296421us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787360109.508473:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 6 00010000:00010000:3.0:1787360109.508578:0:16689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.508588:0:16689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.508596:0:16689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.508602:0:16689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f8600 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:3.0:1787360109.508614:0:16689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.508622:0:16689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.508633:0:16689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787360109.508640:0:16689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049140e5c/0x72f6de40e4ef4dea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360109.508933:0:16689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0e8b748a-0492-40f2-a25b-11c67731819d+7:2365:x1874182509032832:12345-192.168.201.14@tcp:4:dd.0 Request processed in 111945us (296876us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787360109.508941:0:16689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 7 00010000:00010000:2.0:1787360109.512078:0:16691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.512101:0:16691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.512112:0:16691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.512120:0:16691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff983d411f9e00 already unused, calling callback (ffffffffc16a6230) 00010000:00010000:2.0:1787360109.512127:0:16691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.512137:0:16691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.512184:0:16691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787360109.512192:0:16691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096211fc6/0x72f6de40e4ef4dd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787360109.512377:0:16691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d3a038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0e8b748a-0492-40f2-a25b-11c67731819d+5:2365:x1874182509032576:12345-192.168.201.14@tcp:4:dd.0 Request processed in 141831us (300427us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787360109.512390:0:16691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.14@tcp, seq: 4 00000100:00100000:0.0:1787360109.991048:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787360109.991076:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527886720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787360109.991154:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360109.991391:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527886720 00000100:00100000:3.0:1787360109.991444:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527886720 00000100:00100000:3.0:1787360109.991510:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787360109.991524:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d39cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527886720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787360109.991556:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1787360109.992887:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d39cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874182527886720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1352us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360109.992904:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787360109.993016:0:3317:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787360109.993022:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff983d1e18f480, transno 8589934595 00000004:00080000:0.0:1787360109.993039:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787360109.993073:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1874182527886720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787360110.055047:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787360111.079820:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787360111.102983:0:16729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1787360111.527621:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360111.527650:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983d1e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527886848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787360111.527766:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787360111.527900:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527886848 00000100:00100000:2.0:1787360111.527911:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527886848 00000100:00100000:2.0:1787360111.527984:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787360111.527996:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527886848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787360111.528036:0:15151:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787360111.528090:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1874182527886848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787360111.528098:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787360111.528165:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787360111.528205:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983d1e18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1874182527886848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787360111.528466:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787360111.528504:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360111.528527:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787360111.528533:0:3318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527887104:0@lo:400:kworker.0 00000100:00100000:3.0:1787360111.528559:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787360111.528604:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527887104 00000100:00100000:3.0:1787360111.528609:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527887104 00000100:00100000:3.0:1787360111.528647:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787360111.528655:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527887104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360111.528732:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1874182527887104:12345-0@lo:400:kworker.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360111.528739:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787360111.528760:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787360111.528777:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1874182527887104:0@lo:400:kworker.0 00000100:00100000:1.0:1787360111.528858:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527886976:0@lo:400:kworker.0 00000100:00100000:1.0:1787360111.528890:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360111.528921:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527887488:0@lo:400:kworker.0 00000100:00100000:1.0:1787360111.528942:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787360111.528958:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787360111.528964:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff983c0369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527887360:0@lo:400:kworker.0 00000100:00100000:1.0:1787360111.528985:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787360111.529103:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527887232 00000100:00100000:0.0:1787360111.529108:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527887232 00000100:00100000:0.0:1787360111.529140:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527887488 00000100:00100000:0.0:1787360111.529143:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527887488 00000100:00100000:0.0:1787360111.529160:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527887360 00000100:00100000:0.0:1787360111.529163:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527887360 00000100:00100000:0.0:1787360111.529177:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787360111.529184:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527887232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360111.529228:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983c0369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1874182527887232:12345-0@lo:400:kworker.0 Request processed in 44us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.529314:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787360111.529329:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787360111.529345:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527887488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360111.529394:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1874182527887488:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.529400:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787360111.529413:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787360111.529420:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d27f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527887360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787360111.529451:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d27f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1874182527887360:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787360111.529457:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787360111.529620:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1874182527887360:0@lo:400:kworker.0 00000100:00100000:0.0:1787360111.529632:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1874182527887488:0@lo:400:kworker.0 00000100:00100000:3.0:1787360111.532450:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874182527886976 00000100:00100000:3.0:1787360111.532472:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874182527886976 00000100:00100000:3.0:1787360111.532541:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787360111.532552:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff983d2759f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3320:x1874182527886976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787360111.532665:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff983d2759f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f3bf1097-deff-4714-8b83-3baf6c1a0ca6+19:3320:x1874182527886976:12345-0@lo:400:kworker.0 Request processed in 115us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787360111.532673:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787360111.532738:0:14461:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787360111.532790:0:3318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1874182527887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787360111.532836:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff983c0369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f3bf1097-deff-4714-8b83-3baf6c1a0ca6:3320:1874182527886976:0@lo:400:kworker.0 00000040:00080000:1.0:1787360111.984449:0:14498:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787360111.984460:0:14498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787360111.984496:0:14498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787360111.984516:0:14498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787360112.102872:0:14454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29436 lines, 29436 kept, 0 dropped, 0 bad.